-- Logs begin at Wed 2022-07-20 13:06:28 UTC, end at Wed 2022-07-20 14:37:02 UTC. -- Jul 20 13:32:18.145773 dv-cinder-819149-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 13:32:18.154361 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 13:32:18 2022] *** Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: nodename: dv-cinder-819149-11-iscsi Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: machine: x86_64 Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: clock source: unix Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: pcre jit disabled Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: detected number of CPU cores: 4 Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: current working directory: / Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: detected binary path: /usr/bin/uwsgi-core Jul 20 13:32:18.156393 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: your processes number limit is 47680 Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: your memory page size is 4096 bytes Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: detected max file descriptor number: 2048 Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: lock engine: pthread robust mutexes Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: thunder lock: enabled Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 13:32:18.156970 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 13:32:18.200945 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: Python main interpreter initialized at 0x55dcc98539c0 Jul 20 13:32:18.200945 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: python threads support enabled Jul 20 13:32:18.200945 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: your server socket listen backlog is limited to 100 connections Jul 20 13:32:18.200945 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: your mercy for graceful operations on workers is 90 seconds Jul 20 13:32:18.201286 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 13:32:18.201361 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: *** Operational MODE: preforking *** Jul 20 13:32:18.201631 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: *** uWSGI is running in multiple interpreter mode *** Jul 20 13:32:18.201631 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: spawned uWSGI master process (pid: 86818) Jul 20 13:32:18.201826 dv-cinder-819149-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 20 13:32:18.203776 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: spawned uWSGI worker 1 (pid: 86829, cores: 1) Jul 20 13:32:18.203776 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: spawned uWSGI worker 2 (pid: 86830, cores: 1) Jul 20 13:32:18.203776 dv-cinder-819149-11-iscsi devstack@keystone.service[86818]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 13:32:23.652737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:32:23.652737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: from cryptography.utils import int_from_bytes Jul 20 13:32:23.653415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:32:23.653415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: from cryptography.utils import int_from_bytes Jul 20 13:32:23.653549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:32:23.653549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 20 13:32:23.653978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 13:32:23.653978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 20 13:32:23.702506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:32:23.702721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:32:23.702810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 13:32:23.702939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 13:32:23.703023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] command line args: [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:32:23.703163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] command line args: [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 13:32:23.703246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:32:23.703411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ================================================================================ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:32:23.703494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 13:32:23.703648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ================================================================================ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 13:32:23.703731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] admin_token = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.703921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.703999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] config_dir = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_dir = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] config_source = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] debug = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] config_source = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.704743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] debug = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.705859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_config_append = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_config_append = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_dir = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.706959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_dir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.707992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.708940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.709947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.710716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] publish_errors = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] publish_errors = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.711860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] standard_threads = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.712897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] standard_threads = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_journal = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] use_journal = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.713904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_json = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_stderr = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] use_json = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] use_syslog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] use_stderr = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] use_syslog = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.714764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 13:32:23.714931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.715939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.716996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.717924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.718825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.719586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.719723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.719799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.719922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.719922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.720930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.721950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.722930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.723995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.724874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.725918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.726994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.727959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.728115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.728265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.728922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.729948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.730995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.731978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.732986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.733908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.734864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.735990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.736996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.737938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.738970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.739908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.external = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.740857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.password = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.741903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.token = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.external = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.742979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.743756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.password = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.744034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.744706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.token = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.744835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.744835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.745988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.746875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.747909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.748866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.749900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.750932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.751964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.752872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.753933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.754947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.755927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.756989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.757893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.758907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.759925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.760972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.761876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.762950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.763948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.764968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.765908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.766877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.767982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.768971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.769914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.770939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.771886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.772855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.773867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.774979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.775958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] role.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] role.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.776957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.777939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.778942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.779850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.780873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.781840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.782942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.783995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.784870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.785913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.786876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.787984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.788840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.789964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.790726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.791984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.792143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.792236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.792341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:32:23.792421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.792647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.792881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.793131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.793364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.793603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.793838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 13:32:23.794009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 13:32:23.824415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.824650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.824742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.824893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.824977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.825177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.833309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.833439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.862243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.862364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.862476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:23.862575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.003610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.004570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.052886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.053124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.053491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.053734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.117615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.117758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.117839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.117998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.118889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.143768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.144952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.145095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.145222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.145351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.145480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.145480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.156777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.157036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.169957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.170896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.171659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 13:32:24.188633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.188849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 13:32:24.189127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.189257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.189406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 13:32:24.189541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 13:32:24.189672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.189801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.189929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 13:32:24.190057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.190855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.201887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.202950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.210913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.211045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.214794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.214932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.215060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.215185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.215349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.215488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.215749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.215878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.216986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.217761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.244858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.245012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.246456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.246586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.246728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.246860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.251956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.252100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.252248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.252402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.252541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.252674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.260360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.260562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.260692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.260852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.265182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.265468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.265605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.265733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.265871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.266977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.267104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.267230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.267364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.286313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.286591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.286722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.286890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.291278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.291616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.294902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.295199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.295327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.295582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.300208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.300646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.303827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.304309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.307636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.307930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.308888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.309045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.309176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.309330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.309620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.329022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.329392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.329520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.329646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.329802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.329929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.330083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.330361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.338386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.338912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.340094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.340397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.340667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.340947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.343511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.343790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.344154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.344899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.345235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.358048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.358329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.358607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.358741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.358897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.359828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.360073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.360377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.378874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.379645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.382158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.383001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.386031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.386917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.387633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.388567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.389282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.389560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.389849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.390210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.390511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.390804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.397292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.398344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.398895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.399969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.402745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.403033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.403312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.403588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.403795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.404086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.404399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.404678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.412844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.413131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.413410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.413967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.414256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.414538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.421367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.421648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.421926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.422199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.422469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.422547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 13:32:24.422755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.422838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.423906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.424985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.425185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.425453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.425723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.425992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 13:32:24.464259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dcc98539c0 pid: 86829 (default app) Jul 20 13:32:24.465556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dcc98539c0 pid: 86830 (default app) Jul 20 13:32:24.467548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9108d4-a97e-4736-9115-8ffda9592aec None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:24.467846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9108d4-a97e-4736-9115-8ffda9592aec None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:24.468130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9108d4-a97e-4736-9115-8ffda9592aec None None] PATH_INFO: `/v3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:24.472298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Jul 20 13:32:24 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:32.084070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:32.084657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:32.084657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:32.089045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:32:32.094749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:32.095191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:32.097275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:32.167803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: INFO dbcounter [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] Registered counter for database keystone Jul 20 13:32:32.190127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG oslo_db.sqlalchemy.engines [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:32:32.196862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writer thread running {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:32:32.375642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG passlib.handlers.bcrypt [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86829) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 13:32:32.375984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG passlib.handlers.bcrypt [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86829) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 13:32:32.431423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:32.433106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:32.557399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 13:32:32.764691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:32.835165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: INFO dbcounter [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] Registered counter for database keystone Jul 20 13:32:32.855065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG oslo_db.sqlalchemy.engines [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 13:32:32.861511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writer thread running {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 13:32:32.982120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc057-ae33-4a0d-85d8-6a663fb5b325 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:32.986452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:32.987123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:32.987412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:32.987692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:32.996867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:33.048935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 13:32:33.049291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88f316-fab3-4603-b75d-ae4b2168df3d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:33.060381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 20 13:32:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 13:32:33.066398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:33.082169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ba665-2a91-4e61-864b-bb954e17bdf3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:33.086654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:33.088048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:33.088372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:33.088655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] PATH_INFO: `/v3/projects/48523caa484b4c96bfa97c6efa0edb26` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:33.090151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=48523caa484b4c96bfa97c6efa0edb26)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:33.143780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 13:32:33.144371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38c9e-81b9-4335-a9b8-561048d51eb2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:33.148845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Jul 20 13:32:33 2022] GET /identity/v3/projects/48523caa484b4c96bfa97c6efa0edb26 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:35.213552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37234f-46b2-4f0d-aa46-26845fba2b95 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:35.214072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37234f-46b2-4f0d-aa46-26845fba2b95 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:35.214382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37234f-46b2-4f0d-aa46-26845fba2b95 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:35.218731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:35.224564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:35.225004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:35.225131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:35.244789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:35.246403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:35.254548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 13:32:35.277401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37234f-46b2-4f0d-aa46-26845fba2b95 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:35.290693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37234f-46b2-4f0d-aa46-26845fba2b95 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:35.295072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:35.295718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:35.296011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:35.296424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:35.304748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:35.307291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44d1b4-fb6d-4059-b1b3-030a570c2905 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:35.316624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 20 13:32:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:32:35.323170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:35.332906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b77b6-a7ec-4991-95f8-d6ac13e8a38f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:35.337387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:35.338297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:35.338591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:35.338876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:35.340333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:35.342184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de952-5c9f-46a8-903d-7e8b3c8d4860 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:35.343777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Jul 20 13:32:35 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:37.467419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10b97-a9d4-46a5-a75c-5bd26e8f2561 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.470770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10b97-a9d4-46a5-a75c-5bd26e8f2561 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.471063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10b97-a9d4-46a5-a75c-5bd26e8f2561 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.472557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:32:37.477957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.478420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.478569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.495856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:37.497083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:37.511396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594121e-06f7-4dc6-bcfc-5bc9d8d1f3bb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.511685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594121e-06f7-4dc6-bcfc-5bc9d8d1f3bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.511962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594121e-06f7-4dc6-bcfc-5bc9d8d1f3bb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.513531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:32:37.518352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.518642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.519037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.559287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86830) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 13:32:37.559715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86830) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 13:32:37.584869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:37.607009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:37.614421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:37.616134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:37.632686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:37.723779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276fa2-8230-4bdb-9f07-f3ec8db17926 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:37.725753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:37.748836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:37.762209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:37.763030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.763322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.763606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.775677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:37.788074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:37.789190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:32:37.790192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:32:37.797813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:37.870017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c6533-19f4-448f-b236-b7f6b409b900 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:37.873424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:37.893579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:37.915683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaeac0-2a37-48ad-8c4c-3145c5456a43 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:37.918751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:37.919867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.920166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.920481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.955974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:37.956618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:37.957085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:37.957372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:37.958133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:37.958444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:37.959842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:37.976410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:37.978218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:37.995122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:37.996904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.090939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57036267-40ed-4722-a6f6-fc150b6a53a6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:38.099726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:32:38.106247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:38.109826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:38.131242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:38.132214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:38.132569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:38.132890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:38.134121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:38.135700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.137458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:37 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:38.142772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:38.158815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:38.224385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971fd1-9132-4533-b9af-e4ec81038bad None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:38.255650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117802d-97dc-4f52-85ce-87bfde7c011a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:38.261536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:38.262691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:38.262980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:38.263256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:38.282086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:38.283567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.300958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:38.301761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:38.302043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:38.302356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:38.303534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:38.305001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.306966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:32:38.308408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:38.309219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:38.310180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:32:38.310180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:32:38.310180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:32:38.310180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:38.310180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:32:38.312485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:38.316108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:38.382120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:38.399380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:38.422697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42fe35-2d8e-49bd-8923-66e2d1fddcaa None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:38.431055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceba9b0-d8aa-4c02-9d27-72ddafcf093d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:38.457700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:38.458210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:38.458506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:38.458783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:38.459637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.domain.id=default, user.id=96c7a0c328d14b7db355b2f838b651cd) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:38.459915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:38.461407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e54ff-30e5-4f1c-afe3-06e31f569700 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.467672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:38.468451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:38.468815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:38.469090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 20 13:32:38 2022] GET /identity/v3/role_assignments?user.id=96c7a0c328d14b7db355b2f838b651cd&scope.domain.id=default&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:38.469304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:38.470174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:38.470557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:38.472040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4ee2-a174-4a06-b578-3d8ad4b1c47a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:38.493088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:40.818127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4045e-ba5c-464f-8274-30833e4832d6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:40.818653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4045e-ba5c-464f-8274-30833e4832d6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:40.818743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4045e-ba5c-464f-8274-30833e4832d6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:40.820225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:40.825941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:40.826372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:40.828161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:40.848248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:40.849733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:40.925398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:40.947570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4045e-ba5c-464f-8274-30833e4832d6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.083951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4045e-ba5c-464f-8274-30833e4832d6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:41.139338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:41.140161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.140473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.142848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.162914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-33a73cdd-240b-4372-91df-4fb8e9e70e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:41.175500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:41.176364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:32:41.178679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 13/24] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:41.185472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.235248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:41.291840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebbd2c-eec1-4f10-8b24-cf8d39545fa5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:41.320681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286bc09-058f-47bc-a343-76e6ad44e2f3 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.321618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286bc09-058f-47bc-a343-76e6ad44e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.322464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286bc09-058f-47bc-a343-76e6ad44e2f3 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.324956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 14/25] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:41.333748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126415b-e187-4cea-bd68-09d6c010ec1d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.333904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:41.334450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126415b-e187-4cea-bd68-09d6c010ec1d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.334551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.334774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.335057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.335416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126415b-e187-4cea-bd68-09d6c010ec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.335838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:41.336154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:41.337660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:41.343473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:41.363509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e126415b-e187-4cea-bd68-09d6c010ec1d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:41.365075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e126415b-e187-4cea-bd68-09d6c010ec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:41.371594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 12/26] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:41.379240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.510815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 15/27] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:41.512792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06261-d5e1-4cb9-af73-3595ea6b8cb0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.513282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06261-d5e1-4cb9-af73-3595ea6b8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.513926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06261-d5e1-4cb9-af73-3595ea6b8cb0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.515386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 16/28] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:41.534004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.534782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.535261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.562903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:41.564447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:41.626384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625a5c-783a-4e48-852c-0c1acb800e3d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:41.643800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 17/29] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 13:32:41.645192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.647320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:41.705013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:41.706263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.706742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.707260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.709303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:41.711218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:41.713875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 13/30] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:41 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:41.714831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.774872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:41.838183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac50a2-eb89-466a-8f60-46c535305f3f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:41.846722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c3b16-c924-46d5-a57b-aa3322d7982f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:41.876465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:41.877629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.878131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.878601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.891232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:41.893155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:32:41.912444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:41.913367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:41.914139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:32:41.914139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:32:41.914139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:32:41.914139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:41.916131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 14/31] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:41.917335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:41.917642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:41.918343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:41.918634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:41.918919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:41.919689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:41.921718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:41.960067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:42.037649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c266-0046-4b09-8cde-67b20e657478 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.054167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 18/32] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 20 13:32:41 2022] POST /identity/v3/roles => generated 219 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:42.055731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:42.076417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:42.077550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.078025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.078593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.080137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:42.081882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed67562-819e-44e7-b86f-8fe2abf1f596 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:42.083963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 15/33] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:42.085463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24f4a-b1e2-4fdc-938a-2c77d63cf220 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.085953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24f4a-b1e2-4fdc-938a-2c77d63cf220 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.086513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24f4a-b1e2-4fdc-938a-2c77d63cf220 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.088151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 16/34] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:42.090129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24f4a-b1e2-4fdc-938a-2c77d63cf220 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:42.256540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180806b-b069-488c-96b8-7529c5dd18a6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.268517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:42.277290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24f4a-b1e2-4fdc-938a-2c77d63cf220 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.289985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:42.308017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:42.308729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.309027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.309320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.310083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:42.310402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:42.311945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17142c-100c-4f60-8af8-0f5090c773df None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:42.326241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:42.327124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.327408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.327691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] PATH_INFO: `/v3/domains/default/users/96c7a0c328d14b7db355b2f838b651cd/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.329783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=96c7a0c328d14b7db355b2f838b651cd, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:42.331256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f213-26ef-4642-97e8-a1e1869daff9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:42.333358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 19/35] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:42.335113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7e91-79d8-450b-8f26-690e940c3641 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.335591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7e91-79d8-450b-8f26-690e940c3641 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.336054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7e91-79d8-450b-8f26-690e940c3641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.356025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d77e7e91-79d8-450b-8f26-690e940c3641 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:42.358816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d77e7e91-79d8-450b-8f26-690e940c3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:42.430976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 20/36] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:42.432626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb821c-9d93-49d1-86bc-a18bd2214a21 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.433090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb821c-9d93-49d1-86bc-a18bd2214a21 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.433535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb821c-9d93-49d1-86bc-a18bd2214a21 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.439367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 21/37] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:42.440332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb821c-9d93-49d1-86bc-a18bd2214a21 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:42.460230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 17/38] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Jul 20 13:32:42 2022] PUT /identity/v3/domains/default/users/96c7a0c328d14b7db355b2f838b651cd/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:32:42.460230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.460230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.460230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.479954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:42.481624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:42.558880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 18/39] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:42.559657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:42.574881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb821c-9d93-49d1-86bc-a18bd2214a21 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.667242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:42.686345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ba7de-1bc1-4c1b-8704-6d56131a35da None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.711133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:42.724355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:42.725042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.725338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.725613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.726367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:42.727988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c05ad-57f4-48e0-8325-b37b608c4464 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:42.735174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:42.735802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.736110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.736385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.737172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:42.738661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff51d2-787b-4b9b-92dc-6fc18bbbf221 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:42.746894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 19/40] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/roles => generated 225 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:42.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d095-753c-4ed5-8600-470f5a0eb6d7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.748509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d095-753c-4ed5-8600-470f5a0eb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.748770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d095-753c-4ed5-8600-470f5a0eb6d7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.750143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 20/41] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:42.755066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d095-753c-4ed5-8600-470f5a0eb6d7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:42.788360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:42.790073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:42.790580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:42.791087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:42.810942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:42.813562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:42.959321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:42.980468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d095-753c-4ed5-8600-470f5a0eb6d7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:42.985624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:43.019660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:43.020524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:43.020777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:43.021058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:43.022256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:43.023730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:43.026019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 21/44] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:43.031828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:43.055043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:43.108875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:43.121435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217220d-eb54-4947-80e7-19fa8e636ccd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:43.158617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e281b-dd84-43f4-8ace-2b66501a0be7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:43.160993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634be79-97db-4719-a433-c953dee94384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:43.161666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634be79-97db-4719-a433-c953dee94384 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:43.161962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634be79-97db-4719-a433-c953dee94384 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:43.162245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634be79-97db-4719-a433-c953dee94384 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:43.162998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634be79-97db-4719-a433-c953dee94384 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:43.164437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634be79-97db-4719-a433-c953dee94384 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:43.179672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 24/45] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 20 13:32:42 2022] POST /identity/v3/roles => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:43.196770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:43.197576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:43.197871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:43.198213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:43.199069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:43.200889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48654-8be0-4579-9803-a7feb5359efb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:43.233490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:32:43 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:32:44.585848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc815-f589-478e-8023-c0da317bfd25 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:44.586365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc815-f589-478e-8023-c0da317bfd25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:44.586468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc815-f589-478e-8023-c0da317bfd25 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:44.587806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:44.593109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:44.593500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:44.593691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:44.610664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:44.611891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:44.670790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:44.679201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:44.702497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc815-f589-478e-8023-c0da317bfd25 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:44.801830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc815-f589-478e-8023-c0da317bfd25 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:44.835099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:44.835947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:44.836181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:44.836491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:44.846923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:44.855094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:44.855946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:32:44.856804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 26/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:44.863414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:44.959720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcec2b-3d5c-4b9a-a42c-efaaee67ef56 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:44.993941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:44.994624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:44.994910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:44.995188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:44.995927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:44.996260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:44.997644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.005512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 24/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:45.011168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:45.030909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:45.111546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c7d57-fcb5-4233-85da-f555e631efad None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:45.143744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:45.144649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.144939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.145221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.146400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:45.147877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90781609-21c4-48ca-94b5-feef4383211e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.149534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 27/51] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:45 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:45.155557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:45.277991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb131b-42b6-42b4-b6fa-c2fba5ee2ee1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.278315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb131b-42b6-42b4-b6fa-c2fba5ee2ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.278603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb131b-42b6-42b4-b6fa-c2fba5ee2ee1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.280151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 28/52] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:32:45.285026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.285325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.285615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.302673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:45.303884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:45.326410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:45.369325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361918-f661-4493-9846-58a3c1dd7950 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:45.377202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 29/53] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:45.401452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:45.403102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:45.403904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.404218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.404506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.405686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:45.407152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.408806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 25/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:45.414292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:45.416134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:45.499844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10dfe2-0518-45b9-9798-0e026b552764 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:45.515912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e96e-e1e0-455a-8d36-139936d0cac3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:45.534098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:45.534894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.535181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.535458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.536665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:45.538128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.539748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 30/55] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:45.541613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:45.545225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:45.551795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:45.552488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.552781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.553064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.553907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.domain.id=default, user.id=96c7a0c328d14b7db355b2f838b651cd) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:45.554224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:45.555673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd5d0-1122-4f4d-a673-e6b36de761d0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.565502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 26/56] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 20 13:32:45 2022] GET /identity/v3/role_assignments?user.id=96c7a0c328d14b7db355b2f838b651cd&scope.domain.id=default&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:45.630501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:45.653702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85c25-50fc-471d-87dd-016e5ec47654 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:45.689525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:45.690211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:45.690505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:45.690793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:45.691526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:45.693072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6cbf6-4eae-4a2c-bf13-160c1ba66fe2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:45.720788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 31/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 20 13:32:45 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:32:47.734483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025230-f289-4bde-88fb-b62b999df4b7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:47.734972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025230-f289-4bde-88fb-b62b999df4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:47.735083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025230-f289-4bde-88fb-b62b999df4b7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:47.736459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 27/58] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:47.741604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:47.741993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:47.742166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:47.758370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:47.759571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:47.825547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 32/59] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:47.849620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025230-f289-4bde-88fb-b62b999df4b7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:47.946784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025230-f289-4bde-88fb-b62b999df4b7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:47.979456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:47.980267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:47.980554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:47.980833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:47.982007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:47.983463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff19e0-aefd-4e66-a1cb-82ff58a67e62 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:47.985077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 28/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:47.990564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:48.059472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:48.097058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541eed-eb63-4786-ac11-7509af54cf52 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:48.129822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:48.130490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:48.130782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:48.131066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:48.131798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:48.133299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7cfe3-1974-4cd3-934a-2227c738a357 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:48.159659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 33/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:32:47 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:32:51.303425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c1d8-a054-4f4f-af96-a97144719807 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.304357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c1d8-a054-4f4f-af96-a97144719807 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.304782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c1d8-a054-4f4f-af96-a97144719807 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.306657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:51.312334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.313099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.313531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.331477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0986-5ab9-4ccb-9661-8599c4d31bde None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.332098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0986-5ab9-4ccb-9661-8599c4d31bde None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.332599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0986-5ab9-4ccb-9661-8599c4d31bde None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.334154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 30/63] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:32:51.337225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:51.338530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:51.339465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.339952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.340487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.370143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:51.371684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:51.441533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:51.470715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:51.486681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:51.506937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:51.512049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:51.580693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:51.633403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e3a5c-9bdc-49be-8a1b-14fb94315a0d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:51.654278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf1f0-1625-4805-9b0e-66ff31b022bf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:51.674035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:51.675510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.675975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.676463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.692488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:51.698250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:51.699290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.700047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.700550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e65ff34a-5926-4915-b48a-a40e10a2d9be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:51.701727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:51.702546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:51.703380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 32/66] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:32:51.704333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c0b9-5cd9-4f73-bc9f-f0a73089ffb7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.704856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c0b9-5cd9-4f73-bc9f-f0a73089ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.705294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c0b9-5cd9-4f73-bc9f-f0a73089ffb7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.707524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 33/67] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:51.708424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c0b9-5cd9-4f73-bc9f-f0a73089ffb7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:51.722029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6a4c3482-2e5c-46fc-b56b-59d723e58fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:51.734873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:51.735877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:51.736849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:32:51.738935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 35/68] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:51.740528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.741365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.741771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.764363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:51.766025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:51.771920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:51.840957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c0b9-5cd9-4f73-bc9f-f0a73089ffb7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:51.842125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 36/69] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:51.843149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:51.887118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:51.905151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:51.905997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.906482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.906864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.907829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:51.908258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:51.909769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:51.919544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 34/70] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:51.920703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:51.950552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f6d83-3ac8-47d5-be6c-13cc455fe153 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:51.984996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:51.985691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:51.985984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:51.986272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:51.987035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:51.987356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:51.988818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec25c7-e38e-45e7-aa07-ffe2817caa7e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:51.997702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 37/71] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.001498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f902-267d-4681-bd43-c134f1238883 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.001799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f902-267d-4681-bd43-c134f1238883 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.002182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f902-267d-4681-bd43-c134f1238883 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.003462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 38/72] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:52.004245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83f902-267d-4681-bd43-c134f1238883 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.026857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae983-dec2-483a-ad7b-0574ed52a771 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.037482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.062964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.063784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.064079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.064396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.074955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b5635f5d-976b-442a-a4c4-eb14cc6253fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:52.083139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:52.084153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:52.084937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:32:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:52.085625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583eb5a-8874-4087-81ad-15b49b995aea None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.085922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583eb5a-8874-4087-81ad-15b49b995aea None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.086207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583eb5a-8874-4087-81ad-15b49b995aea None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.087558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 36/74] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:52.088322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583eb5a-8874-4087-81ad-15b49b995aea None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.112259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83f902-267d-4681-bd43-c134f1238883 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.113751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.147907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.148828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.149118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.149399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.151151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.152675 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125e219-fc6e-449b-8cc5-5bb8aa858656 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.154307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 39/75] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.159898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.160217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.160509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.177465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:52.178668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:52.192718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583eb5a-8874-4087-81ad-15b49b995aea None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.226121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.227002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.227290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.227573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.243130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.245203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 40/76] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:52.245321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34d53b-a90c-48f4-a27d-2189c07ea3f5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.246263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.251169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 37/77] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.251169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.251169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.251169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.266720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:52.267983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:52.290733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.335768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 38/78] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:52.336656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.355245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.359347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8efdf-e70f-44f3-9365-0859b7f29c75 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.394002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.394672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.394959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.395240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.395985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:52.396328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.397717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.405999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 41/79] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.409090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.437884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa73d-0f01-4add-a6dd-6a756bd067f8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.473298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.473945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.474230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.474521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.501238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.509110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73909-299b-4912-9d3b-be7b97782d4f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.541733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.542383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.542685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.542968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.543473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.545018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.574459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.611899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.613415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.644345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 39/80] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:32:52.645223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.704150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.714871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 42/81] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:32:52.715719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.746840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1399-034e-4a88-a694-9ec2a73816c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.777479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.780159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.780984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.781276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.781559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.792036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:52.799758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:52.800607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:52.801380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 40/82] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:52.807178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.816367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bf33-8e17-4faa-a937-59defc9de2d1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.849514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.850315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.850607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.850894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.852086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.854120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.855752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 43/83] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.860778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.909728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9b41-2f78-4abd-ab63-b89ccc7bfcc0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.926092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:52.943283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:52.944161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:52.944483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:52.944770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:52.945978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:52.947986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:52.949901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 41/84] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:52.949901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:52.959817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6799f8-c70d-4aca-80b9-6fa5950beae8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:52.999073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.005352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.008630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.008630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.008630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.008630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.009473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.011732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 44/85] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.012524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.052167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610db84-e260-49cc-a2f8-6354cd162f4f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.085876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.086737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.087024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.087304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.089077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.090534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.092242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 42/86] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:52 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.092988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.118768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d019976-cc3b-43ca-b3f7-6e3d88d4072c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.150879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.153321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.154027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.154317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.154601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.155340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:53.155647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.157075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.165039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 45/87] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.165767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.202170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca0c1f-9049-4dd9-add7-862febd7e6fd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.223176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.235345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.236022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.236352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.236643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.237378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.238848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.264649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 43/88] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:32:53 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:53.265311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.265410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344e09-e039-466a-8800-26c23b5fa1d2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.304762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.305546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.305917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.306322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.397685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.399215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.400120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff18d-fac7-4122-a4af-1b35fe7e2f30 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.414100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.448371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.448967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.449262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.449537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.450637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=96c7a0c328d14b7db355b2f838b651cd) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:53.451916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.452454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.458877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 44/89] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/role_assignments?user.id=96c7a0c328d14b7db355b2f838b651cd&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.459678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.479157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.539749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 46/90] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:32:53.548770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.613409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42974d3-775d-4412-9332-27f0d61555ec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.682638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.683324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.683594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.683876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.684747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:53.685070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.686529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.696149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 45/91] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.699204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b618a1-67c7-4452-bd4b-4452f9517fad None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.701665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.753881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.755174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.755475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.755934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.757990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.759748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.761722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 47/92] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.768370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.793184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.820363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:53.893535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab582cc9-bb2c-4fa6-98f7-c52ad173fc39 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:53.950356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:53.951207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:53.951504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:53.951788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:53.953562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:53.955069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:53.956904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 46/93] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:53.963545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:53.996699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d69-72c2-48e9-a5cc-1023d577635c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:54.036941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:54.037614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:54.037910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:54.038198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:54.112768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:54.114290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:54.143638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:54.199038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d6ec-8341-483c-95a6-bba6ec03c6bc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:54.212247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:54.219674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 48/94] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:32:54.229170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:54.267904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:54.268605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:54.268902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:54.269189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:54.270035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:54.270357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:54.271840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:54.286594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 47/95] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:32:53 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:54.362393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ebdff-2fd3-409a-92e8-537a98709f94 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:54.392602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:54.403158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:54.404045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:54.404373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:54.404660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] PATH_INFO: `/v3/projects/f5ded586001e4223bf6e0a697957075c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:54.405880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] RBAC: Authorizing `identity:get_project(project_id=f5ded586001e4223bf6e0a697957075c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:54.407375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f81fb5-c12c-4f74-8a04-550e2d8f7f02 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:54.409145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 49/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:54 2022] GET /identity/v3/projects/f5ded586001e4223bf6e0a697957075c => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:54.415246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:54.545794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499b177-353b-40ea-b16b-e36a2790eee3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:54.596938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:54.597623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:54.597919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:54.598207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:54.599058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=f5ded586001e4223bf6e0a697957075c, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:54.599372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:54.600884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f1ec-a374-4755-91c9-048e21f502b5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:54.607580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 48/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:32:54 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=f5ded586001e4223bf6e0a697957075c&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:56.242149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af73-ba2b-4f8e-ac48-4df84ee244fa None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.242668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af73-ba2b-4f8e-ac48-4df84ee244fa None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.242740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af73-ba2b-4f8e-ac48-4df84ee244fa None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.244893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 50/98] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:56.250461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bf599-5489-4d57-8e55-5ae2125202ef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.250868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bf599-5489-4d57-8e55-5ae2125202ef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.251054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bf599-5489-4d57-8e55-5ae2125202ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.273551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-770bf599-5489-4d57-8e55-5ae2125202ef None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:56.274781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-770bf599-5489-4d57-8e55-5ae2125202ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:56.311898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:56.365867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 49/99] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:56.397797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58467f8-219a-41c5-a86e-da999ed2fe22 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.398431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58467f8-219a-41c5-a86e-da999ed2fe22 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.398917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58467f8-219a-41c5-a86e-da999ed2fe22 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.401074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 51/100] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:56.405895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58467f8-219a-41c5-a86e-da999ed2fe22 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:56.406556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.406909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.407204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.428224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:56.429445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:56.551553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:32:56.566467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58467f8-219a-41c5-a86e-da999ed2fe22 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:56.599216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:56.618090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:56.619460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.619958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.620482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.639061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ccf118a6-3006-4f67-911c-83b321573a09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:56.654132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:56.655028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:32:56.655857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:32:56.658659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 52/102] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:56.664874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d306-e144-4603-9f8f-a54f0c5950e2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.664874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d306-e144-4603-9f8f-a54f0c5950e2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.665172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d306-e144-4603-9f8f-a54f0c5950e2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.672387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 53/103] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:56.673129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415d306-e144-4603-9f8f-a54f0c5950e2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:56.750406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:56.761481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3af21-4db2-4e1c-91a3-13b3355f3a4e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:56.766686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:56.800091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:56.801280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.801776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.802208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.813439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6080623a-275e-4b71-9c6e-48eea975c21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:56.821870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:56.823504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:32:56.824452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:56.826649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 51/104] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:32:56.828080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.828545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.828994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.844896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415d306-e144-4603-9f8f-a54f0c5950e2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:56.846557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:56.848002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:56.883586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:56.884370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.884780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.885091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.885974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:56.886340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:56.887940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26497944-c180-48fd-955a-1df1f5560806 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:56.897193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 54/105] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:56.898893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc1a7-aa4b-4239-a168-bd7251627497 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:56.899437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc1a7-aa4b-4239-a168-bd7251627497 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:56.899877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc1a7-aa4b-4239-a168-bd7251627497 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:56.906249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 55/106] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:56.907212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fc1a7-aa4b-4239-a168-bd7251627497 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:56.921093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 52/107] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:56.928262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.027179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fc1a7-aa4b-4239-a168-bd7251627497 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.041196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.058566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483825ae-c0be-4b30-8119-068f16f51d99 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.065995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.082396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.083095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.083517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.083812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.084729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:57.085058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.086709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccf747-ff08-4ee0-b9af-749f962516b8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.095900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.096938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.097330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.097745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] PATH_INFO: `/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.100759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 56/108] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.102660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.102966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.103289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.112936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] RBAC: Authorizing `identity:get_user(user_id=8bd7d81aee214d3e9f9aa0cb816b7cfa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.114566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.116636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 53/109] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:56 2022] GET /identity/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.117330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.121494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:57.122683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:57.201099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:57.209277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.220736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d180-704d-4d2d-b71f-0af327eb33d7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.256167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.257225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.257651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.258031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.269067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:57.277495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:57.278381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:57.279142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:57.279786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.285980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.363860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dcdf0-3e29-4560-a868-fd86358b7cce None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.379138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.410106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.410991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.411797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.412089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.413593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.416037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.422304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 58/112] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.422304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.423748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cf5ec-5b85-4d9a-b013-9c2c168068f6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.462010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.462735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.463522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.463810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.535565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ada-16fc-4b96-9b87-657a5b05c95d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.538080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.539579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538e65-9a1b-41c0-b4ae-55bd1bb43bf5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.541522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.569387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.570177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.570469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.570759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.572601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.574071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.575974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 59/113] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.576730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.623410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.640860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 55/114] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:32:57.642206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9a5b-3ea5-43f2-be50-caebf1cb3424 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.642508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9a5b-3ea5-43f2-be50-caebf1cb3424 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.642793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9a5b-3ea5-43f2-be50-caebf1cb3424 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.644107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 56/115] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:57.648786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9a5b-3ea5-43f2-be50-caebf1cb3424 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.681116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbb299-33d3-474b-9f63-e0e054666d86 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.715481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.716150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.716469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.716750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.717496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:57.717807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.719216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5407-25e5-40b4-a22a-8154d9af857b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.727100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 60/116] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.729059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ab29-8ebd-4243-9f98-20a70061a132 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.729358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ab29-8ebd-4243-9f98-20a70061a132 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.729638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ab29-8ebd-4243-9f98-20a70061a132 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.731040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 61/117] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:32:57.732925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9ab29-8ebd-4243-9f98-20a70061a132 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.749576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9a5b-3ea5-43f2-be50-caebf1cb3424 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.751227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.785383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.786245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.786533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.786814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.787996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.789479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.791802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 57/118] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.792600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.847250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9ab29-8ebd-4243-9f98-20a70061a132 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.857994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:57.885259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.885846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.886189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.886477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.887210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.888734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc04a0-2bbe-4c18-9f54-d439a1125788 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.894839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849534-fa19-404b-be62-34f6b5793f5a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:57.914323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 62/119] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:32:57 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:32:57.920336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7855-c3bb-46cc-824b-581fbbf4a351 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.920336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7855-c3bb-46cc-824b-581fbbf4a351 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.920336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7855-c3bb-46cc-824b-581fbbf4a351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.936652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:57.937554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:57.937850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:57.938136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:57.939420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:57.940981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:57.942780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 58/120] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:57.948054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:57.953649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a1af7855-c3bb-46cc-824b-581fbbf4a351 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:57.954922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a1af7855-c3bb-46cc-824b-581fbbf4a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:58.000062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.034075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 63/121] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:58.035407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.035710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.036000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.056749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:32:58.057983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:32:58.082311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394562-d26e-4dca-a2dd-4ca55a5e66ee None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.123474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.124384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.124678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.124962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.126914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:58.128488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:58.130350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 59/122] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:57 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:58.130924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.144310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 64/123] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:32:58.144310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.168904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.245634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5b2d-1b44-470f-b0d8-65c792b4e068 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.254385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.263137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e12c-c40b-456c-b85f-08d6bea19e66 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.285670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.286560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.286848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.287128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/96c7a0c328d14b7db355b2f838b651cd/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.289158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user_id=96c7a0c328d14b7db355b2f838b651cd, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:58.290776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:58.300577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.301249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.301541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.301812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.302649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=8bd7d81aee214d3e9f9aa0cb816b7cfa) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:58.302970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:58.304175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 60/124] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:32:58 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/96c7a0c328d14b7db355b2f838b651cd/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:32:58.305007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.309887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:58.327258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 65/125] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/role_assignments?user.id=8bd7d81aee214d3e9f9aa0cb816b7cfa&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=86d992267dda443fb9c42df5d9134143 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:58.329206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.431006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494188e-c38d-4b3a-8dfe-03f50085cec0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.478514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.481732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.482888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.483392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.483883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.499188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:58.508609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:58.509603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:32:58.510870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:58.513609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 61/126] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:58.514946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.538701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930a03-be88-4740-8e25-178030a9af96 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.551427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.587377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.588361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.588659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.588946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.590307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:58.591920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:58.593935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 66/127] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:58.594534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.658096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ea87-965a-4623-b16c-4e2efd63209f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.719274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.720113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.720447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.720727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.730774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70a30-cf81-4278-9c12-3b2cdb48869e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.749199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:32:58.769505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:32:58.770412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 62/128] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:32:58.771163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.783648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.785280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:58.785797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:58.786668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:58.787953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:58.788535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:58.791479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:58.811167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 67/129] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:58.811790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:58.848265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.904220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:58.930613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01643e-2024-44e7-9e32-fe067dc47ef0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.996623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790395d5-5f93-4d84-adb9-a406858f394b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:58.997468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:58.998536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.000141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.000582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/2cb14195ce0944b5b78a96382ce231ed/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.003889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user_id=2cb14195ce0944b5b78a96382ce231ed, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.010210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.029860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 63/130] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:32:58 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/2cb14195ce0944b5b78a96382ce231ed/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:32:59.031108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.074327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.075347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.075699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.076012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.076811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:32:59.077240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.080094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.089249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 68/131] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:32:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:59.101107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.272530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bf29f-86ab-4730-b11d-3c27fec69e85 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:59.287954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:59.334754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.335645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.335933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.336249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.338573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.340043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.341711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 64/132] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:59 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:59.347055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.348149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a406d-7de9-49d8-b70f-f3cc58d05997 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:59.365804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:59.452918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.453823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.454122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.454407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.455675 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.457175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.458995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 69/133] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:32:59 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:32:59.465053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.516451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1ebf-a3b3-41b7-83cf-b00bf03a8c33 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:59.560807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.561659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.561945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.562226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] PATH_INFO: `/v3/projects/f5ded586001e4223bf6e0a697957075c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.563550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] RBAC: Authorizing `identity:get_project(project_id=f5ded586001e4223bf6e0a697957075c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.565058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.567226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 65/134] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:59 2022] GET /identity/v3/projects/f5ded586001e4223bf6e0a697957075c => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:59.579332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.653517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1527-792f-4d1a-b5fc-9ea206b558fc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:59.692443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:59.713156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e311-0cde-4c18-9488-db6c2d4686ec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:32:59.731610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.732868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.733354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.733853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.735339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.737029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.746288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 70/135] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:32:59 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:32:59.747589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:32:59.754715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:32:59.755614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:32:59.755943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:32:59.756990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] PATH_INFO: `/v3/projects/f5ded586001e4223bf6e0a697957075c/users/2cb14195ce0944b5b78a96382ce231ed/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:32:59.762044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] RBAC: Authorizing `identity:create_grant(project_id=f5ded586001e4223bf6e0a697957075c, user_id=2cb14195ce0944b5b78a96382ce231ed, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:32:59.770413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30b6cd-a1b5-46a4-98c5-3c63c8eab6ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:32:59.780988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:32:59.789097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 66/136] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:32:59 2022] PUT /identity/v3/projects/f5ded586001e4223bf6e0a697957075c/users/2cb14195ce0944b5b78a96382ce231ed/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:32:59.998440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f22ce-aa48-4088-a348-496314b6097f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:00.057529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:00.058472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:00.058767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:00.059053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/2cb14195ce0944b5b78a96382ce231ed/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:00.061555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user_id=2cb14195ce0944b5b78a96382ce231ed, role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:00.063068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1678f2-1f00-4f7b-88a0-daddcab308ce None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:00.082909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 71/137] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:32:59 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/2cb14195ce0944b5b78a96382ce231ed/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:00.469135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf749a3-c22d-4f42-ae7d-fe6580143c50 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:00.469664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf749a3-c22d-4f42-ae7d-fe6580143c50 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:00.469740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf749a3-c22d-4f42-ae7d-fe6580143c50 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:00.471765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 67/138] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:00.476519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:00.476824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:00.477115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:00.501264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:00.502489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:00.581467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:00.617618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf749a3-c22d-4f42-ae7d-fe6580143c50 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:00.754348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf749a3-c22d-4f42-ae7d-fe6580143c50 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:00.790173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:00.791047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:00.791343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:00.791633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:00.792835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:00.794299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95430ec-cb06-426b-8e87-81394e500456 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:00.796363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 68/140] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:00.801456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:00.803708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:00.920980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfe85d-09d5-4edd-b7fe-280de70969de None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:00.966863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:00.967559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:00.967852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:00.968140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:00.968961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:00.970462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287a3a-b5cc-4899-bdd8-0974c1c902f8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:00.998138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 73/141] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:00 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:33:01.208516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5280-f8d9-4b32-88bc-c3e7198ef03e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.208901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5280-f8d9-4b32-88bc-c3e7198ef03e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.209101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5280-f8d9-4b32-88bc-c3e7198ef03e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.210739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 69/142] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:01.226031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.226330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.226616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.250340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:01.251553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:01.329444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:01.347731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 74/143] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:01.374439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5280-f8d9-4b32-88bc-c3e7198ef03e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:01.396028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:01.529477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5280-f8d9-4b32-88bc-c3e7198ef03e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:01.570797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:01.571595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.571890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.572261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.591970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a2612c63-436c-4f65-863a-a5e4390f2c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:01.599761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:01.600613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:01.601365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 70/144] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:01.607031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:01.687841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2428-e884-4f34-b371-c94872275493 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.688154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2428-e884-4f34-b371-c94872275493 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.688444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2428-e884-4f34-b371-c94872275493 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.689842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 71/145] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:01.702113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.702403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.702686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.721128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:01.723108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:01.802461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b5da-681f-4c07-ada8-fbc79fa9a2d3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:01.828629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:01.837059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 72/146] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:01.864572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:01.878875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:01.879572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:01.879870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:01.880156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:01.880961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:01.881280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:01.882775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:01.904957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 75/147] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:01.908477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:01.990694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.027714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d017-251c-4263-9ed0-4ffdefec3c69 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.052378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3debad-0f2d-4a13-8a62-17b4642f510a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.071993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.072840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.073203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.073553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.085644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:02.092508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.093660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.094121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.094592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] PATH_INFO: `/v3/users/96c7a0c328d14b7db355b2f838b651cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:02.095118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:02.095930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:02.100794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 73/148] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:02.101633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] RBAC: Authorizing `identity:get_user(user_id=96c7a0c328d14b7db355b2f838b651cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.103124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.105182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.105711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 76/149] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:01 2022] GET /identity/v3/users/96c7a0c328d14b7db355b2f838b651cd => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:02.111649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.196600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.274463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc16cb-984e-42d5-83e1-369f541e5313 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.312963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.313652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.313940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.314222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.314982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:02.315297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.316481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992bb4-030b-49b5-8ba2-ea4cebd3f176 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.316774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.327915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 74/150] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:02.333307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.357605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.380904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.381582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.381877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.382241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.446775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434ab6-1c45-4716-b074-8156d740cc1a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.489379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.490888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b003879-765a-4d0f-af77-32f2cdd131c2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.493599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.494536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.494825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.495107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] PATH_INFO: `/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.496407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] RBAC: Authorizing `identity:get_user(user_id=8bd7d81aee214d3e9f9aa0cb816b7cfa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.497891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.499873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 75/151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:02.505288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.506003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.625705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace70f-56de-4862-a7cd-c0eb5025eb45 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.632620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 77/152] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:02.634041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8cd0-4941-4dd5-a993-42cfae1cdb7d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.634445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8cd0-4941-4dd5-a993-42cfae1cdb7d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.635741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8cd0-4941-4dd5-a993-42cfae1cdb7d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.636834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 78/153] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:02.637359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a8cd0-4941-4dd5-a993-42cfae1cdb7d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.670992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.678208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.679091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.679378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.679674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.681867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.683352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d237-33d8-4e49-bbda-df234a40e499 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.685152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 76/154] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:02.686329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.686623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.686909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.709861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:02.711283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:02.776612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:02.785086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:02.786066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:02.904088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a8cd0-4941-4dd5-a993-42cfae1cdb7d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.933583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978666e-36a7-4ac0-ac69-79925de284e5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:02.970575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:02.971479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:02.971765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:02.972046 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/8bd7d81aee214d3e9f9aa0cb816b7cfa/roles/86d992267dda443fb9c42df5d9134143` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:02.974245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user_id=8bd7d81aee214d3e9f9aa0cb816b7cfa, role_id=86d992267dda443fb9c42df5d9134143)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:02.975714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:02.990944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 78/156] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:02 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/users/8bd7d81aee214d3e9f9aa0cb816b7cfa/roles/86d992267dda443fb9c42df5d9134143 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:02.991795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:03.032950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.033852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.034145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.034431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.041182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:03.042720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:03.044830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 79/157] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:03.053248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:03.073081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:03.132429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38875-7982-4da7-ab99-de56e7692fd6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:03.202509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.203375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.203700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.203983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.207615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:03.222324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:03.238597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:03.239603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:03.241382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 79/158] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:03.246014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:03.260739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2c944-5d6e-4f5b-9d48-91de560d08b2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:03.353384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.354159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.354445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.354723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.355566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=96c7a0c328d14b7db355b2f838b651cd) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:03.355874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:03.357588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:03.373131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc3d91-92a8-41cf-bf2b-a010a9f1b631 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:03.374728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 80/159] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:03 2022] GET /identity/v3/role_assignments?user.id=96c7a0c328d14b7db355b2f838b651cd&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:03.385084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:03.416785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.417486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.417775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.418057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.418833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:03.419147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:03.420622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:03.430243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 80/160] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:03.436341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:03.561506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ec1-fa97-41e0-b3bc-13966e52aae0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:03.606044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.607027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.607332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.607578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.608961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:03.610483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cfe2f-ee8c-4628-a5cb-d09b7591a136 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:03.616278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 81/161] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:03 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:03.617915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:03.746420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247b7c1-558d-40d7-9f68-6732744e2ba4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:03.756895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69913-5aa5-4eee-bfe0-81bb28f40761 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.757173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69913-5aa5-4eee-bfe0-81bb28f40761 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.757452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69913-5aa5-4eee-bfe0-81bb28f40761 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.758832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 82/162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:03.763861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819508-0cad-4e00-8f0c-4efb9e562738 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.764157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819508-0cad-4e00-8f0c-4efb9e562738 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.764476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819508-0cad-4e00-8f0c-4efb9e562738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.789395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:03.790098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.790392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.790673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.797200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7d819508-0cad-4e00-8f0c-4efb9e562738 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:03.798400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d819508-0cad-4e00-8f0c-4efb9e562738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:03.827509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:03.852665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:03.886925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:03.888879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:03.937398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 83/163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:03.938755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c578-60d0-4d05-844d-b1d423be725b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.939046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c578-60d0-4d05-844d-b1d423be725b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.939325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c578-60d0-4d05-844d-b1d423be725b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.940725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 84/164] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:03.946675 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:03.946989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:03.947311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:03.977313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:03.978585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:04.007791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 81/165] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:04.014546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.100638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:04.119501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 85/166] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:04.120219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.153029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a8834-0c18-439c-b263-21f528fe4b1f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.194909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.195934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.196226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.196532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.198270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:04.200261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:04.202037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 82/167] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:04.204721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.315703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659acec2-399a-4dfb-a52a-86a810a9c290 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.331256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:04.354845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.355573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.355863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.356145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.363641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:04.367924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:04.376474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:04.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:04.378322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 83/168] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:04.379531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.410133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553700a-c411-41b8-8b65-a1644db70cef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.481950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.482778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.483066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.483347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.492759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f148f-3291-4052-bc7a-a4cef2997091 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.494826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:04.503193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:04.504066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:04.504943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 86/169] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:04.505580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.556168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.557439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.557726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.558007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.558851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:04.559166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:04.560662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:04.582891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 84/170] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:04.583713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.709699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96684db-373f-4333-aee8-a3790fbb5774 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.736600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:04.780345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.781031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.781314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.781591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.782359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:04.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:04.785765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:04.804567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:04.813993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 87/171] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:04.823709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863c3e3-e95c-4e86-b2ea-c46c309573f7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:04.825317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:04.894101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:04.894795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:04.895080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:04.895358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:04.896123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:04.897043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:04.898484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:04.916692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 85/172] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:04.922572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.036728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96c9c4-c77d-4511-bed4-227dcb316216 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.080927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.081829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.082119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.082408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.084926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.086402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.088457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 88/173] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:05.099815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.129251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4287d-7f1a-4b0c-bf91-7cb1f8401367 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.170857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.190643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.191574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.193767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.194199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] PATH_INFO: `/v3/users/2cb14195ce0944b5b78a96382ce231ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.195779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb14195ce0944b5b78a96382ce231ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.197565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.199367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 86/174] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:04 2022] GET /identity/v3/users/2cb14195ce0944b5b78a96382ce231ed => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:05.205109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.209430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.211050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa90d-0a17-497a-ae48-e26fd72ffa0a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.252440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.253104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.253396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.253681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.329249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.330738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5e4a4-94c3-4d3f-a713-2d653241cb55 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.345949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ac6f-d719-450b-8864-5a4a8bf6e866 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.401392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.402297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.402731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.403155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.435867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.497148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.499819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 89/175] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:05.505235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f711f-0b14-4770-b4b2-b0f9b34c435e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.505704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f711f-0b14-4770-b4b2-b0f9b34c435e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.506161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f711f-0b14-4770-b4b2-b0f9b34c435e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.507654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 90/176] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:05.509974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.511471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.514231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.514681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.515134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.542127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:05.543612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:05.613010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 91/177] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:05.614190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.713779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 87/178] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:05.714465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.722045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9072411-dc2a-4d0a-8fcc-9fa6a4aa860b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.728518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.774942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.776302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.776795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.777288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] PATH_INFO: `/v3/projects/f5ded586001e4223bf6e0a697957075c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.778719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] RBAC: Authorizing `identity:get_project(project_id=f5ded586001e4223bf6e0a697957075c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.780427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.782685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 92/179] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/projects/f5ded586001e4223bf6e0a697957075c => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:05.783660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.898172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:05.915319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c63-4e0e-41f3-9c9d-8c0e643abac6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.926317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bfcf-ad15-4a5e-bf75-1d86b846d235 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:05.969450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.970681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.971176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:05.971671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:05.977108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:05.979410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:05.983460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 93/180] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:05.985680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:05.994012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:05.995124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:05.997354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.004704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.021194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:06.030665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:06.031571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:06.032389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:06.034877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 88/181] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:06.035876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.084546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.155010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a769-54c2-4a6c-aca8-d46c7c6b86a7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.159568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fff83-b774-431e-bccf-1ad1912ae7d7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.190206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.190865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.191145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.191422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.192275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:06.192594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.194043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.200887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.201547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.201831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.202104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.202206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 89/182] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:06.202933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.203037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=f5ded586001e4223bf6e0a697957075c, user.id=2cb14195ce0944b5b78a96382ce231ed) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:06.203316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.204872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d46b76-5677-4f4a-850d-3ee46dbf95ea None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.213114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 94/183] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:05 2022] GET /identity/v3/role_assignments?user.id=2cb14195ce0944b5b78a96382ce231ed&scope.project.id=f5ded586001e4223bf6e0a697957075c&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:06.220426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903e014-a1ac-4a81-8141-827317c0171c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.221068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903e014-a1ac-4a81-8141-827317c0171c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.221579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903e014-a1ac-4a81-8141-827317c0171c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.223322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 95/184] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:06.225019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da23-7daa-454c-93c7-36e664bfe59b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.228034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da23-7daa-454c-93c7-36e664bfe59b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.229234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da23-7daa-454c-93c7-36e664bfe59b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.231014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 96/185] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:06.238984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298df92-21ee-4294-b056-4b2ee5945458 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.240753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298df92-21ee-4294-b056-4b2ee5945458 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.241505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298df92-21ee-4294-b056-4b2ee5945458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.253951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.273795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f298df92-21ee-4294-b056-4b2ee5945458 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:06.277280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f298df92-21ee-4294-b056-4b2ee5945458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:06.412626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 97/186] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:06.414299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.414597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.414879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.424773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990bde-9425-4b2b-b5ff-f57f5300327b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.438142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:06.440014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:06.469094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.469924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.470213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.470535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.471150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.471684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:06.471684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.473467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e5f9-6292-45f3-9077-c2da8153642e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.484559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 90/187] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:06.485943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c148-a249-4bdc-aa57-000254093e66 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.486238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c148-a249-4bdc-aa57-000254093e66 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.486516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c148-a249-4bdc-aa57-000254093e66 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.488231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 91/188] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:06.488911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c148-a249-4bdc-aa57-000254093e66 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.532551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:06.533448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.580912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.604974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c148-a249-4bdc-aa57-000254093e66 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.632624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46991-0376-49fe-9afe-2ded359cca75 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.637926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.638729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.639015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.639292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.640500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.641979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9f4e7-9588-4924-877e-7fdecb1db057 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.643603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 92/190] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:06.644769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.645205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.645323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.663256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:06.664469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:06.669504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.670374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.670657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.670934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.684714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.686216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.687898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 99/191] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:06.688691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.708448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.744468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 93/192] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:06.744468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.801043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9311-fa4e-4401-ad11-b2004f7b3d81 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.805896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.829778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0fb32-c299-410e-be9f-baa150766834 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:06.835898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.836755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.837040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.837324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.847849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:06.856711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:06.857565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:06.858349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 100/193] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:06.858987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.868117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:06.868836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:06.869125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:06.869398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:06.870108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:06.871537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:06.891803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 94/194] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:06 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:06.897308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:06.946627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:06.974241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986fc6-694b-419c-948b-ba4ba19efe71 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.014425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.015002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.015287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.015565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.016311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac4cf-ab80-41bd-a4b4-afc4bcd78ed9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.050654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.060971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.060971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.060971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.061254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.074789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:07.083325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:07.084213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:07.085022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:07.092214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 95/195] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:07.092214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.097167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.099468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.196661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.217343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f2aa-6c6f-48ba-b1d9-6ca9d3847266 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.224712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 101/196] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:07.228693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.258797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.260675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.261526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.262288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.263538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:07.264535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.266403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.277768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 96/197] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.283117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.342188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.346541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d615-30a0-42d8-a9e8-61b2f19d648f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.386247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.387362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.387854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.388418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.389482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:07.390004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.390116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15fc97-6237-4184-93ce-1f8e32728165 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.391833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.401460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 102/198] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.402576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.430896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.432173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.432492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.432769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.433954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.435797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.437316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 97/199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.438218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.449560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.518491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4dc1-d373-4872-b375-3626bed596c2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.543422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03674-8cbf-4cca-8348-bfa798047ba7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.557840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.559011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.559504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.560043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.561671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.563353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.569922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.570433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 103/200] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.571838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.579243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.580174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.580540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.580819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] PATH_INFO: `/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.582080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] RBAC: Authorizing `identity:get_user(user_id=8bd7d81aee214d3e9f9aa0cb816b7cfa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.583764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.585306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 98/201] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/users/8bd7d81aee214d3e9f9aa0cb816b7cfa => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.590973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.684139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229d51-b88f-4f96-ab54-660002eeaebd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.697861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bdbf-970e-4dec-9dbc-1e185326e50a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.704608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.723587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.724574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.725131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.725829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.726957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=9ea7f08de7354e4f955db455f1b22f81) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:07.727482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.729546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.734790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.735447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.735731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.736007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.737108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 104/202] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/role_assignments?user.id=9ea7f08de7354e4f955db455f1b22f81&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:07.738477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:07.800903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.811873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.813407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:07.855465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3657bb-7151-47f8-b463-6310e066fd5b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:07.894376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:07.895457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:07.895947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:07.896463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:07.964546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:07.993131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:07.996764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:08.010952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 99/203] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:08.018861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:08.110436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 105/204] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:08.135367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:08.160702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:08.172880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc179be-3d30-4b5e-a09a-881437273369 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:08.249817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:08.250681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:08.250960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:08.251231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:08.252565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:08.254069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:08.258199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 100/205] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:08 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:08.262151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:08.284123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:08.339601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d355f-c5e4-425f-8f11-b1ebd022963f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:08.385015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:08.385884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:08.386328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:08.386746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:08.388117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:08.389829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:08.396391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 106/206] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:08 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:08.398328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:08.419941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa69502-b7bc-435a-b9ec-43fee9f5c094 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:08.463613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:08.464811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:08.465250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:08.465675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:08.466925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=9ea7f08de7354e4f955db455f1b22f81) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:08.467416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:08.469072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e212a8-f086-4be3-bc77-da0e47e68e7a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:08.476383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 101/207] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:08 2022] GET /identity/v3/role_assignments?user.id=9ea7f08de7354e4f955db455f1b22f81&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:08.550287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562765a2-baad-4cc4-88fb-3604cbbd11bd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:08.588991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:08.589949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:08.590390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:08.590865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:08.591932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4, user.id=8bd7d81aee214d3e9f9aa0cb816b7cfa) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:08.592453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:08.594136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1f755-0cf3-4f39-9bf2-3225ffd91270 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:08.601604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 107/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:08 2022] GET /identity/v3/role_assignments?user.id=8bd7d81aee214d3e9f9aa0cb816b7cfa&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=86d992267dda443fb9c42df5d9134143 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:09.182861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52922c-64b3-4945-a025-489d0655794c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.183372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52922c-64b3-4945-a025-489d0655794c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.183480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52922c-64b3-4945-a025-489d0655794c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.184845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 102/209] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:09.190342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.191204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.191683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.197675 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.213480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:09.214696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:09.300368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 108/210] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:09.326339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52922c-64b3-4945-a025-489d0655794c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.355622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.440688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52922c-64b3-4945-a025-489d0655794c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:09.476003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:09.476830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.477116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.477392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.487946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1f3ce280-012d-4f1f-b137-dd9cc714f0ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:09.495767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:09.496639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:09.497676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 103/211] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:09.503125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.522153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84b7e-e156-4dce-b501-f4289e6d9fb0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.522752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84b7e-e156-4dce-b501-f4289e6d9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.523047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84b7e-e156-4dce-b501-f4289e6d9fb0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.524708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 104/212] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:09.535563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.535984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.536302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.558812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:09.560021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:09.623377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b24a19-c3d1-4220-9aac-8ca4f50c990c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:09.656540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 105/213] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:09.674868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.682175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:09.682880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.683174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.683458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.684295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:09.684662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:09.684920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.686124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:09.696254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 109/214] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:09.701411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.702769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.797347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce39cc-18c4-4ce0-829a-9e5ff15fa3ba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:09.818281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a21a9-457a-4b83-810a-b56ff7abdb59 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:09.834523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:09.835320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.835610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.835961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.837109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:09.839429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:09.845552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 106/215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:09.846633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.858926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:09.860244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.860761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.861293 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] PATH_INFO: `/v3/users/2889735d96ba4ce394e483ef80d6160e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.876978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] RBAC: Authorizing `identity:get_user(user_id=2889735d96ba4ce394e483ef80d6160e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:09.878770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:09.880959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 110/216] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:09 2022] GET /identity/v3/users/2889735d96ba4ce394e483ef80d6160e => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:09.886540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:09.933884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.947616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:09.957384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc801c-0b0e-4cca-bee4-f844fe3e1d63 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:09.994795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:09.995481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:09.995767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:09.996045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:09.996789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:09.998426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1de324-7fe8-4e30-892c-85312efba05d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.001302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bba6-a518-4c0d-96f9-0beec698c466 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.022289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 107/217] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:09 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:10.044973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.046014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.046506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.046989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.067830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f8ba-f812-49ab-b899-c50d8f0e7a73 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.068224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f8ba-f812-49ab-b899-c50d8f0e7a73 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.068468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f8ba-f812-49ab-b899-c50d8f0e7a73 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.070092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 108/218] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:10.076882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.077399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.077753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.096816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:10.098268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:10.128439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:10.130374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.183474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 109/219] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:10.189206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:10.206987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.246016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 111/220] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:10.252808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.296350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:10.344559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55862c-a5ff-405b-9ae6-cfdb3f707627 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.395475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323b047-bdd7-4580-a4a8-1e03cd858168 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.403893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.404775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.405373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.405373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.421610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:10.430043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:10.431158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:10.432658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:10.435141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 110/221] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:10.441467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.447660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.448616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.448909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.449192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.450722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:10.452222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.456785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 112/222] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:10.461157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.488416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:10.610545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebe50a-2ba3-463b-892e-8b12a8e71f13 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.659134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.659816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.660105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.660421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.661279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=2889735d96ba4ce394e483ef80d6160e) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:10.661598 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:10.663084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860055-a487-490a-b768-08b18a6e73d8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.677319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 113/223] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/role_assignments?user.id=2889735d96ba4ce394e483ef80d6160e&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:10.686741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9206a4-1698-4b26-ad3f-b91cd48a316d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.704009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4792e-518c-4627-bf80-a7fa87256987 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.704330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4792e-518c-4627-bf80-a7fa87256987 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.704614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4792e-518c-4627-bf80-a7fa87256987 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.707266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 114/224] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:10.711920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.712166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.712454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.721034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:10.741738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.742722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.743159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.743586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.744605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:10.745071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:10.746950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.756317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:10.757710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:10.758141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 111/225] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:10.764504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.891383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 115/226] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:10.940905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:10.942778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8117-1c4b-4777-8ff2-5efe28245930 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:10.961470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:10.983028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:10.984465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:10.984990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:10.985471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:10.986925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:10.988624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:10.990925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 112/227] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:10.998312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.064553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc10f0-c6fd-43c7-822a-525c51ad4029 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.095750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:11.120626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.122171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.122739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.123216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.134800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:11.143494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:11.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:11.145195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:11.147957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 116/228] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:11.154391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.219189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225d6e7-7149-4e9a-b08e-16b75c77761b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.240776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:11.269255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d60f-0277-4823-98d0-99de059a2441 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.308267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.309304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.310200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.311154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.312126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:11.312816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.314426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.328759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 117/229] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:11.330958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.377462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.378345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.378629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.378907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.385012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.386484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.388229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 113/230] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:10 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:11.394282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.443901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2ae5-b9c8-4bb6-b0c6-905c5274c65c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.482750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.484026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.484726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.485455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.486922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.488608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.491468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 118/231] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:11 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:11.497164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.507474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:11.616240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476b62-d36f-412e-acf7-be728ad4391f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.626275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a606b6-4364-4468-aa07-c558f2f085aa None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.658782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.659772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.660133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.660527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.661811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.663448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.667052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 119/232] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:11 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:11.674169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:11.674926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:11.702423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.703330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.703616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.703894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/9ea7f08de7354e4f955db455f1b22f81/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.709714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, user_id=9ea7f08de7354e4f955db455f1b22f81, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.711370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f4a8b-6d30-4a6c-a335-00c6d2b2b2ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.750835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 114/233] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:11 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/9ea7f08de7354e4f955db455f1b22f81/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:11.771972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:11.793153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d1d3-697d-4f33-9322-93cbd8597e31 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:11.831210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:11.832117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:11.832449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:11.832732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/9ea7f08de7354e4f955db455f1b22f81/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:11.835137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, user_id=9ea7f08de7354e4f955db455f1b22f81, role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:11.836713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ef58-753f-42e6-942e-698790d663ff None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:11.854473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 120/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:11 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/9ea7f08de7354e4f955db455f1b22f81/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:12.744336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8736-3996-48e8-9975-c9615275bacb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:12.744840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8736-3996-48e8-9975-c9615275bacb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:12.744914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8736-3996-48e8-9975-c9615275bacb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:12.746586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 115/235] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:12.762599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:12.763117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:12.763117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:12.784221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:12.785418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:12.794093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014196ab-8dc0-42dc-9226-f4558660397f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:12.794419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014196ab-8dc0-42dc-9226-f4558660397f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:12.794664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014196ab-8dc0-42dc-9226-f4558660397f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:12.796375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 116/236] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:12.801333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:12.801626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:12.801913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:12.823819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:12.825555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:12.902887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 117/237] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:12.908764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 121/238] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:12.925416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:12.950387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.028221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87405fdf-8ede-42b7-8c51-7a910a863e2f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.041593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.057786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.067682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.068598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.068956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.069337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.080450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6a0ce852-2c56-41ee-b8d4-dfcac2265a86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:13.088260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:13.089149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:13.089946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 118/239] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:13.090928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061928-bb5d-41fe-b2f1-e5746d5db83f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.095743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061928-bb5d-41fe-b2f1-e5746d5db83f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.096106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061928-bb5d-41fe-b2f1-e5746d5db83f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.097685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 119/240] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:13.101876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01061928-bb5d-41fe-b2f1-e5746d5db83f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.118281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c2b72-a838-4726-bfc6-5362e18a2288 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.177571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.178604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.179134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.180127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.182356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.184718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688ac-6140-4f42-8b3b-ba65da81abe3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.192132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 122/241] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:13.193699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.194164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.194692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.215919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:13.217247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:13.234094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01061928-bb5d-41fe-b2f1-e5746d5db83f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.269658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.270603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.270970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.271326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.272181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:13.272597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.274169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.288688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 120/242] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:13.289722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.295235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 123/243] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:13.296456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.327004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.385356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.421038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dbcb-a4f4-4de1-a639-38b926318445 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.441478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea5fc-4f9f-4908-85ae-2ae4abc12cf3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.461084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.462133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.463152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.463632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.464686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.466351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.481369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.482258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.482538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.483976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] PATH_INFO: `/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.489705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 121/244] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:13 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:13.496342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.502408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] RBAC: Authorizing `identity:get_user(user_id=73cb023fa8e94a0b8d7a1424b9f743bf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.503952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.512256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 124/245] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:13.512256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.647766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.666208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4cd7-9b38-4607-9984-962ec96c1d22 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.721155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.722049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.722340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a248-3648-46b6-b138-0dd8555d5810 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.722519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.722899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.735662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:13.742239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:13.748164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:13.749386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:13.750174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 122/246] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:13.755332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.764184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.764920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.841036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.842637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.870888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4c3ff-5dc4-4ae1-a4d9-5aeda9f1e548 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:13.908943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:13.909629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:13.909921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:13.910204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:13.911071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:13.911390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:13.912932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:13.922383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 123/247] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:13.927866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.946631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:13.955156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 125/248] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:13.960457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:13.980505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.043297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52472c-b223-4136-88d0-1682d571467b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.068456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b335b7-cdb1-493f-86e5-f9432778200e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.080991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.081902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.082164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.082443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] PATH_INFO: `/v3/users/2889735d96ba4ce394e483ef80d6160e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.083664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=2889735d96ba4ce394e483ef80d6160e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:14.085276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:14.087234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 124/249] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/users/2889735d96ba4ce394e483ef80d6160e => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:14.093235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.108184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.109434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.109969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.110429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.111796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:14.117073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:14.121971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 126/250] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:13 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:14.127412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.186443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.207144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aedccf-0391-4b8f-9751-332a1a063ba0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.245259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.245702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e2c33-2ca8-4d9a-939e-ecfb89feb3ad None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.246114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.246438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.246733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.247986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:14.250181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:14.250855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.256522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 125/251] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:14 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:14.258461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.289701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.290664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.291580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.292076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.293592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=73cb023fa8e94a0b8d7a1424b9f743bf) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:14.294192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:14.296058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c8c7-1a45-4b25-9796-8e0fcfdb8e77 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:14.303297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 127/252] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:14 2022] GET /identity/v3/role_assignments?user.id=73cb023fa8e94a0b8d7a1424b9f743bf&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=86d992267dda443fb9c42df5d9134143 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:14.326114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1c8eb-e1cd-420d-8bf7-f79f1025992d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.326540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1c8eb-e1cd-420d-8bf7-f79f1025992d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.326922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1c8eb-e1cd-420d-8bf7-f79f1025992d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.329537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 128/253] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:14.338322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234717f-ff38-4739-8fba-4511e1f79c45 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.338605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234717f-ff38-4739-8fba-4511e1f79c45 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.338929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234717f-ff38-4739-8fba-4511e1f79c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.366430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b234717f-ff38-4739-8fba-4511e1f79c45 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:14.367656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b234717f-ff38-4739-8fba-4511e1f79c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:14.377499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fd5e0-01c4-4a04-a394-05cfd9d10801 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.417583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.418562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.418853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.419175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/2889735d96ba4ce394e483ef80d6160e/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.421369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, user_id=2889735d96ba4ce394e483ef80d6160e, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:14.422990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:14.440673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 126/254] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:14 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/2889735d96ba4ce394e483ef80d6160e/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:14.451195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 129/255] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:14.492050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.507082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.511075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45f09-1fcd-4038-9395-8f9f4685ac46 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.511510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45f09-1fcd-4038-9395-8f9f4685ac46 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.511861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45f09-1fcd-4038-9395-8f9f4685ac46 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.517964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 130/256] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:14.521763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.522383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.522999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.549714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:14.550976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:14.667770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 131/257] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:14.681884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73e-0b3b-467d-91a3-ad9248fe9caf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.707301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.728955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.729778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.730066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.730346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:14.734836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.758888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:14.768003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:14.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:14.769662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:14.777138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 127/258] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:14.786950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:14.904852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aae98-5829-4387-91eb-67a1c8add6d6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.919382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:14.969078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9c22-75d1-4633-a8dc-95338b977d2f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:14.973793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:14.974679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:14.974968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:14.975248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.002802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:15.018153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:15.019004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:15.019793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:15.026200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 132/259] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:15.032319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.047348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.048048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.048365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.048654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.049413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:15.049728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.051133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.068298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 128/260] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:15.075023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.160577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:15.241755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3217f-b245-4ec3-a75a-26fcc0ee2bbb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:15.282767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcecc27-13bc-4c37-bf90-e55dfceba74f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:15.307034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.307753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.308059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.308367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.309292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:15.309744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.311312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.328537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 133/261] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:15.333177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.343532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:15.354408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.355488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.355781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.356064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.357306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.359111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.360960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 129/262] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:15.366480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.489729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc8abd-6fc3-48a4-b88c-813258e51140 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:15.491380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d128-b564-43e1-989a-71f4b0b1466c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:15.532544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:15.536752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.537366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.537657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.537942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.548937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.549837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.550121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.550398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] PATH_INFO: `/v3/users/9ea7f08de7354e4f955db455f1b22f81` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.551671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] RBAC: Authorizing `identity:get_user(user_id=9ea7f08de7354e4f955db455f1b22f81)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.553158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.555767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 134/263] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/users/9ea7f08de7354e4f955db455f1b22f81 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:15.560135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.612802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:15.617238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.619282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.695898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f85e6-75e4-490e-8303-9cbff10f16b9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:15.731478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:15.732133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:15.732465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:15.732749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:15.818838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:15.819458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:15.828485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:15.832732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 130/264] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:15.841183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:15.992835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 135/265] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:16.000003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:16.030071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:16.033098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e97e8f-b270-465c-9590-b0de79e3acf6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:16.101716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:16.102650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.102942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.103785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.106339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:16.107951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:16.109734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 131/266] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:16.116446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:16.147517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:16.154936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81a924-f098-4b38-b5c3-58c2473fa03d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:16.214316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:16.215190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.215488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.215771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.220933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:16.222429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:16.224531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 136/267] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:15 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:16.230378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:16.382615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199caa6-cb61-464d-a37a-583dec5abec5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:16.409093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9ad-69e0-44ac-9562-bef405ec5f9b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:16.451902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:16.453593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.454200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.455292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.456498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=9ea7f08de7354e4f955db455f1b22f81) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:16.458129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:16.460428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc92fbf-559f-4930-84a9-6635f911d590 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:16.474390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:16.475372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.475852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.476347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 132/268] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:16 2022] GET /identity/v3/role_assignments?user.id=9ea7f08de7354e4f955db455f1b22f81&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:16.476840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.477962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=9ea7f08de7354e4f955db455f1b22f81) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:16.479157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:16.481237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b8e97-9823-4885-9ea9-328d625c883f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:16.488551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 137/269] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:16 2022] GET /identity/v3/role_assignments?user.id=9ea7f08de7354e4f955db455f1b22f81&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:16.889756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424561-d51a-416d-ba1e-28f3fc6ed1f6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.890236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424561-d51a-416d-ba1e-28f3fc6ed1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.890236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424561-d51a-416d-ba1e-28f3fc6ed1f6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.891747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 133/270] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:16.896963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19097-c573-44c8-95c4-2195ed0fc881 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:16.897261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19097-c573-44c8-95c4-2195ed0fc881 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:16.897540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19097-c573-44c8-95c4-2195ed0fc881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:16.916155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d5b19097-c573-44c8-95c4-2195ed0fc881 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:16.917516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d5b19097-c573-44c8-95c4-2195ed0fc881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:16.948850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.001661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 138/271] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:17.026760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38424561-d51a-416d-ba1e-28f3fc6ed1f6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.064137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.111810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e20-7beb-47ef-a841-3e3045b7d5b0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.112152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e20-7beb-47ef-a841-3e3045b7d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.112402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e20-7beb-47ef-a841-3e3045b7d5b0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.113908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 139/272] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:17.119750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.120393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.120881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.147164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:17.148601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:17.167567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38424561-d51a-416d-ba1e-28f3fc6ed1f6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.205943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.206739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.207021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.207293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.220503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:17.225630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 140/273] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:17.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:17.233357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:17.234346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 134/274] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:17.235778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.254585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.354374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.367793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fe515-da4f-4b8a-90d3-c53ab456d5ef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.377419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.389344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6146-ce37-420f-bd16-87af27f87c17 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.416991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.417626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.417966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.418253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.419015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:17.419327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:17.420771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:17.430286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 141/275] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:17.435992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.437294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.438372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.438815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.439231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.440620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:17.442268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:17.444380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 135/276] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:17.453388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.559543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6c32-5c24-4453-b9c7-29bdac063fab None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.569676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b53a0-abca-41ba-838f-d47b9c82b134 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.597156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.598023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.598307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.598580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] PATH_INFO: `/v3/users/d4362b8087874d268dd33eeb33fe2f8b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.605104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.605768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.606053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.606331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.607044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:17.608527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1410-6f19-49e9-84d0-0045bfbaccd6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:17.611789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d4362b8087874d268dd33eeb33fe2f8b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:17.613288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf781780-0f36-490a-9eca-d9f1c3b925b3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:17.615097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 142/277] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/users/d4362b8087874d268dd33eeb33fe2f8b => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:17.617780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c854d9-1347-405f-a7fb-1408cb98c7e1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.618083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c854d9-1347-405f-a7fb-1408cb98c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.618374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c854d9-1347-405f-a7fb-1408cb98c7e1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.619842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 143/278] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:17.621346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435af8c-f5b1-41e1-8933-8d0cee5864c0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.621641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435af8c-f5b1-41e1-8933-8d0cee5864c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.622321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435af8c-f5b1-41e1-8933-8d0cee5864c0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.623725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 144/279] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:17.624375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435af8c-f5b1-41e1-8933-8d0cee5864c0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.636290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 136/280] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:17 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:33:17.636290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764a01-d3f2-4efd-be02-d50982950d2f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.636290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764a01-d3f2-4efd-be02-d50982950d2f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.636290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764a01-d3f2-4efd-be02-d50982950d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.657352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.659644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-30764a01-d3f2-4efd-be02-d50982950d2f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:17.661152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-30764a01-d3f2-4efd-be02-d50982950d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:17.674803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.745774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 137/281] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:17.747013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.747373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.747722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.765845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:17.767200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:17.776112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435af8c-f5b1-41e1-8933-8d0cee5864c0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.823629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:17.824411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:17.824768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:17.825389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:17.826292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, user.id=d4362b8087874d268dd33eeb33fe2f8b, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:17.826709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:17.828309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:17.834865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 145/282] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/role_assignments?user.id=d4362b8087874d268dd33eeb33fe2f8b&scope.system=all&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:17.837131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.848668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 138/283] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:17.871632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:17.946710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:17.985191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220f44-ed58-47f1-937d-40ed36dd9c65 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:17.989929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:18.030230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496a6e-21ad-49ad-92df-cbea30a253d3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.037313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.038126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.038414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.038690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.052313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:18.062938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:18.063829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:18.064639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 146/284] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:18.071367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.072593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.073672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.074165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.074665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.086624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:18.094823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:18.095691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:18.096510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:18.099171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 139/285] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:18.105054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.194179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48980ed-b33f-42ab-b8a7-61a55fd35ce2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.214945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d9763-f095-48ff-a443-3da0be4143b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.231763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.232502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.232755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.233041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.233801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:18.234112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.235506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.237839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:18.245426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 147/286] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:18.253026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.262417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.263085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.263374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.263657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.264457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:18.264768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.266186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.270207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:18.284956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 140/287] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:18.290652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.457302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe109d-bc10-40c5-bb83-be75d8c1a7f4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.489570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d586-7ae8-49a0-bf7c-0afc2cfc4e87 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.524925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.525819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.526104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.526522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] PATH_INFO: `/v3/users/2889735d96ba4ce394e483ef80d6160e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.529553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=2889735d96ba4ce394e483ef80d6160e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.531053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.533019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 148/288] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/users/2889735d96ba4ce394e483ef80d6160e => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:18.538273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.548325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.549635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.549918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.550192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] PATH_INFO: `/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.552986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] RBAC: Authorizing `identity:get_user(user_id=73cb023fa8e94a0b8d7a1424b9f743bf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.554739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.561217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 141/289] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:18.567564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.666202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:18.698874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:18.736650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896442f-ba3b-49f3-a92e-dc0fe579cbb6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.764129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e206-f0fc-4d4f-8970-6489e49c3655 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.809646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.810307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.810596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.810881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.834605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.836219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.836507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.836786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.838177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.841283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.843214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 142/290] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:18.849267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:18.954439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6435-6132-4db5-988f-71399b6e79d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:18.990653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:18.991663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:18.991957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:18.992266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/73cb023fa8e94a0b8d7a1424b9f743bf/roles/86d992267dda443fb9c42df5d9134143` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:18.993237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.994425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, user_id=73cb023fa8e94a0b8d7a1424b9f743bf, role_id=86d992267dda443fb9c42df5d9134143)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:18.994778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:18.995862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:19.000538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:19.016017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 143/291] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:18 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/users/73cb023fa8e94a0b8d7a1424b9f743bf/roles/86d992267dda443fb9c42df5d9134143 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:19.092540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:19.150649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 149/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:19.156620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:19.305820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976519d-037a-4127-a57c-88808c5ff564 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:19.345197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:19.346068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:19.346353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:19.346632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:19.347830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:19.349319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3395472-8bd9-4a1a-9454-ee001266103f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:19.351661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 144/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:19 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:19.357495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:19.501841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7dbef-f6ea-48e8-971f-f2d0021004c3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:19.554253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:19.554914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:19.555201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:19.555481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:19.556439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=2889735d96ba4ce394e483ef80d6160e) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:19.556700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:19.558157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659fed0-d42b-4137-8a74-d86a80ffdf3d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:19.568902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 150/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:19 2022] GET /identity/v3/role_assignments?user.id=2889735d96ba4ce394e483ef80d6160e&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:20.130827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209abcc-61f4-48c0-8282-33834e5835b6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.131335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209abcc-61f4-48c0-8282-33834e5835b6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.131442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209abcc-61f4-48c0-8282-33834e5835b6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.133046 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 145/295] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:20.138423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfca8-158b-4814-a199-7501da27d43d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.139294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfca8-158b-4814-a199-7501da27d43d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.139770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfca8-158b-4814-a199-7501da27d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.160123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4c7dfca8-158b-4814-a199-7501da27d43d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:20.161956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4c7dfca8-158b-4814-a199-7501da27d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:20.193237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.253140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c267ed-92d6-40de-9f02-3c1421e0845e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.253778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c267ed-92d6-40de-9f02-3c1421e0845e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.254257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c267ed-92d6-40de-9f02-3c1421e0845e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.255959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 151/296] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:20.257371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 146/297] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:20.262620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.262917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.263200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.264097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0919-7c98-4bde-bbe0-4ba6c4274146 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.264625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0919-7c98-4bde-bbe0-4ba6c4274146 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.265110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0919-7c98-4bde-bbe0-4ba6c4274146 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.269731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 147/298] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:20.271643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.272127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.272601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.282690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:20.283888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:20.296473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:20.297814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:20.360353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 152/299] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:20.360753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.361533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.379436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 148/300] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:20.381175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.462176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.473546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e70570-7508-4490-9069-1fc40e80c781 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.507528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766a004-c4ed-4e91-b02d-ab6ad2d932e2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.509738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.510679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.517368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.517704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.528904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:20.536793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:20.537707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:20.538480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 153/301] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:20.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.555948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.557521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.557866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.558201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.559531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:20.561537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:20.563457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 149/302] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:20.564774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.629983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.663339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022820-90a2-4e35-bb35-8f75e5e6e26c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.682900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3189-0ad0-4bf0-a496-aaacc516a276 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.699894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.700981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.701272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.701550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.711968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:20.718902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.719568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.719853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.720129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:20.720305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:20.721138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:20.721894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:20.722491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:20.722491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:20.722611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 154/303] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:20.723239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.727244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:20.741009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 150/304] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:20.741009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.742276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.837755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5365b-d92b-4a87-9ffb-351dd4467431 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.840992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014cb8-8cb2-4aee-9c93-24187300fbf2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:20.863722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:20.877030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.877584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:20.877698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.877977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.878255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:20.878440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] PATH_INFO: `/v3/groups` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.878590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:20.878820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:20.878968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:20.879568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:20.879879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:20.880446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:20.881292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:20.895425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 151/305] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:20.895425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:20.904353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 155/306] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 20 13:33:20 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:20.904353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:21.003813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:21.028049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde0f7-7643-44d1-a977-9a1259312d71 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.051609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18888f9-3260-4498-b593-ac8d2536fc58 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.077511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.078813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.079103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.079384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] PATH_INFO: `/v3/users/d4362b8087874d268dd33eeb33fe2f8b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.080637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] RBAC: Authorizing `identity:get_user(user_id=d4362b8087874d268dd33eeb33fe2f8b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:21.082087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:21.083901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 152/307] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/users/d4362b8087874d268dd33eeb33fe2f8b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:21.090335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:21.104838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.105719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.106005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.106379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] PATH_INFO: `/v3/users/2bd0548866684339a8cda82a628b2cc6` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.124363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd0548866684339a8cda82a628b2cc6)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:21.126118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:21.128609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 156/308] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:20 2022] GET /identity/v3/users/2bd0548866684339a8cda82a628b2cc6 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:21.135930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:21.163932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:21.215782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ffd5-2d52-42ef-b13d-c43139c903aa None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.251506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.252728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.253014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.253292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] PATH_INFO: `/v3/system/users/d4362b8087874d268dd33eeb33fe2f8b/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.254799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d4362b8087874d268dd33eeb33fe2f8b, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:21.256211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abf80b-bcc4-46b5-b77e-79cabb3545d4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:21.274348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 153/309] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 20 13:33:21 2022] PUT /identity/v3/system/users/d4362b8087874d268dd33eeb33fe2f8b/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:21.274541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d5cb-906b-42c9-ae4f-dc57e6b346b5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.308596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:21.316940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b237-69a5-4b62-9310-914922925534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.317546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b237-69a5-4b62-9310-914922925534 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.317837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b237-69a5-4b62-9310-914922925534 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.318128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b237-69a5-4b62-9310-914922925534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.319065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b237-69a5-4b62-9310-914922925534 None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, user.id=2bd0548866684339a8cda82a628b2cc6, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:21.319386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b237-69a5-4b62-9310-914922925534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:21.320910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b237-69a5-4b62-9310-914922925534 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:21.327374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 157/310] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 20 13:33:21 2022] GET /identity/v3/role_assignments?user.id=2bd0548866684339a8cda82a628b2cc6&scope.system=all&role.id=86d992267dda443fb9c42df5d9134143 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:21.520661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47539-eedc-4c0a-9fcc-e18fbfeb5bdf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.521035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47539-eedc-4c0a-9fcc-e18fbfeb5bdf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.521210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47539-eedc-4c0a-9fcc-e18fbfeb5bdf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.522679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 154/311] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:21.528175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.528721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.529209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.546599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:21.548091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:21.619847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 158/312] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:21.641083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47539-eedc-4c0a-9fcc-e18fbfeb5bdf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:21.750884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47539-eedc-4c0a-9fcc-e18fbfeb5bdf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.768114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:21.790059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.790851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.791138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.791417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.802249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:21.810623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:21.811523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:21.812600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 155/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:21.819351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:21.919275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e753cf6-269d-4624-a2ed-f8048c39b553 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:21.942714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:21.955095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:21.955764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:21.956054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:21.956367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:21.957445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:21.957798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:21.959187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:21.972071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 159/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:21.977282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:22.086634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbafb7-f468-434b-b839-46bb3768a898 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:22.122952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:22.123862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:22.124147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:22.124456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] PATH_INFO: `/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:22.125911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=73cb023fa8e94a0b8d7a1424b9f743bf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:22.127433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:22.133822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 156/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:21 2022] GET /identity/v3/users/73cb023fa8e94a0b8d7a1424b9f743bf => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:22.135757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:22.240549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c5728-fe91-49b6-8dd2-6113f67b209e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:22.275924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:22.276673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:22.276894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:22.277174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:22.334406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:22.350948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:22.352400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:22.464352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 160/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:22.466830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:22.518301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:22.575945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6900-d17a-49ee-becb-780b8cf90ec0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:22.610436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:22.611228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:22.611514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:22.611790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:22.613002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:22.614466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4288-d207-46cd-9544-380b24a11261 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:22.616483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 157/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:22 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:22.623127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:22.713156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:22.725874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06ec28-d4b1-4d40-a1ab-bcbf76472512 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:22.761124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:22.761790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:22.762077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:22.762359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:22.763189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, scope.project.id=92f3e1feec5443f3b44652af1386f05d, user.id=73cb023fa8e94a0b8d7a1424b9f743bf) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:22.763506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:22.764975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760f5b-0a37-449c-ae97-df8c42591cc3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:22.771174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 161/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:22 2022] GET /identity/v3/role_assignments?user.id=73cb023fa8e94a0b8d7a1424b9f743bf&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=86d992267dda443fb9c42df5d9134143 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:23.106312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0e08-417f-4a17-8e8e-49b3f6fc9d23 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.106681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0e08-417f-4a17-8e8e-49b3f6fc9d23 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.106879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0e08-417f-4a17-8e8e-49b3f6fc9d23 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.108289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 158/319] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:23.113417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.113713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.113998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.131374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:23.132605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:23.202934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 162/320] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:23.225553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a0e08-417f-4a17-8e8e-49b3f6fc9d23 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.330511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a0e08-417f-4a17-8e8e-49b3f6fc9d23 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:23.344026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:23.366271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:23.366965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.367253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.367532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.369250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:23.370720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2958da-629c-4325-9f79-d499d22f2c2e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:23.372375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 159/321] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:23.377979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.457366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866a84-6025-423c-a624-68549c4d0ef4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.457658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866a84-6025-423c-a624-68549c4d0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.457936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866a84-6025-423c-a624-68549c4d0ef4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.459302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 160/322] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:23.460452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1ce2-fc87-4331-baa4-c988105434b4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.460562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:23.460724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1ce2-fc87-4331-baa4-c988105434b4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.461283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1ce2-fc87-4331-baa4-c988105434b4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.462252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 161/323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:23.465241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.465525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.465797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.482530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:23.483717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:23.485856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf9b68-0f57-4674-98b2-311cdc4e2dd8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:23.519169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:23.519827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.520111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.520414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] PATH_INFO: `/v3/groups` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.521110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:23.522540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc65c16-e0e2-4818-bddf-2245bdda1caf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:23.548222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 163/324] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 20 13:33:23 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:33:23.548222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.548222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.548222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.557400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:23.559522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:23.567465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 162/325] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:23.590393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.650817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 164/326] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:23.675006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.703565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04bb4-796c-4dd2-a4c4-d7d2a3b2fe35 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:23.715207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:23.743984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:23.744821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.745104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.745376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.754460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:23.756497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:23.765851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:23.766742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:23.767572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 163/327] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:23.773348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.800778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f80a-d40e-46ce-a49c-7947ca2ea5cf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:23.849485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:23.850305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.850753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.851034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.866304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:23.876253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:23.877357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:23.878299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:23.879015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 165/328] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:23.889278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:23.903990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca7a6-bc67-4196-ad36-55e11bc66582 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:23.951073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:23.951759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:23.952043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:23.952359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:23.953109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:23.953412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:23.955374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:23.965985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 164/329] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:23.971417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:24.014917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:24.044881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5507e24-8576-4c31-9a23-3f2064a93b38 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:24.075000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:24.084621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:24.085307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:24.085593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:24.085874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:24.086803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:24.087125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:24.089317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:24.091764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b89a63-b04a-4ad3-ad86-b62b7eef2cca None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:24.098415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 166/330] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:24.104029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:24.128477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:24.129775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:24.130254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:24.130722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] PATH_INFO: `/v3/users/2bd0548866684339a8cda82a628b2cc6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:24.132428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] RBAC: Authorizing `identity:get_user(user_id=2bd0548866684339a8cda82a628b2cc6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:24.134113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:24.140356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 165/331] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:23 2022] GET /identity/v3/users/2bd0548866684339a8cda82a628b2cc6 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:24.142562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:24.217440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5f67-b114-4398-8b57-f25757ed5ba4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:24.250809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:24.254458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca58cb-fae8-4959-8b3d-26275232159f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:24.268743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:24.269622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:24.269912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:24.270194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] PATH_INFO: `/v3/users/d4362b8087874d268dd33eeb33fe2f8b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:24.271402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d4362b8087874d268dd33eeb33fe2f8b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:24.273142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:24.274769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 167/332] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:24 2022] GET /identity/v3/users/d4362b8087874d268dd33eeb33fe2f8b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:24.280936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:24.294592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:24.295783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:24.296305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:24.296776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] PATH_INFO: `/v3/system/users/2bd0548866684339a8cda82a628b2cc6/roles/86d992267dda443fb9c42df5d9134143` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:24.299653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2bd0548866684339a8cda82a628b2cc6, role_id=86d992267dda443fb9c42df5d9134143)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:24.301374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3cc4-6353-4317-b4eb-72344772d911 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:24.317978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 166/333] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 20 13:33:24 2022] PUT /identity/v3/system/users/2bd0548866684339a8cda82a628b2cc6/roles/86d992267dda443fb9c42df5d9134143 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:24.363095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:24.412050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b746-9cc4-411a-88cd-136daafd52f3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:24.451209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:24.451885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:24.452175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:24.452486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:24.453408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] RBAC: Adding query filter params (role.id=eb9da8ce88ff4b8880fa8fb43b026333, user.id=d4362b8087874d268dd33eeb33fe2f8b, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:24.453726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:24.455265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7835c-89fd-4318-978d-826c0f6a7660 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:24.477105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 168/334] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 20 13:33:24 2022] GET /identity/v3/role_assignments?user.id=d4362b8087874d268dd33eeb33fe2f8b&scope.system=all&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:26.087530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f51c5-4860-4a6e-81e7-d211c4bb4164 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.088051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f51c5-4860-4a6e-81e7-d211c4bb4164 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.088155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f51c5-4860-4a6e-81e7-d211c4bb4164 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.089743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 167/335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:26.095287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.096097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.096663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.118031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:26.120232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:26.204517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5024-a5af-4749-938b-8462434829dc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.204836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5024-a5af-4749-938b-8462434829dc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.205093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5024-a5af-4749-938b-8462434829dc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.206730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 168/336] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:26.209461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 169/337] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:26.215370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.215668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.215956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.249188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:26.250399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:26.295618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.342990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 169/338] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:26.360981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:26.385765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.422188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54d842-214c-46a4-975b-6e33dd3a659b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:26.460105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:26.461194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.461686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.462210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.473849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:26.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:26.483936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:26.484774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:26.487662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 170/339] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:26.493056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.538351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:26.559063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6ff9-ca5f-4039-9c3a-4048ce7e87d9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:26.609973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bec0dd-b29b-48b3-996f-584e3161a213 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:26.616917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:26.617749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.618030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.618304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.619515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:26.638198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:26.646570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:26.647473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:26.652785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:26.655240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 170/340] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:26.661047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.669278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:26.670043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.670423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.670784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.671642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:26.672027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:26.673540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:26.687641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 171/341] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:26.692866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.804629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0581-1231-43dc-a545-69ee20954625 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:26.819656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c32864-72fa-4551-bd15-8d4adbede227 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:26.842898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:26.843989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.844526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.845016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.877681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:26.878157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:26.878441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:26.878717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:26.879469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:26.879832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:26.881220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:26.895730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 171/342] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:26.897238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:26.901997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:26.926601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:26.928676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:26.930435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.087086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ba47-bbc9-44b2-89af-705acd9ebfd1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.124835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 172/343] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:27.130526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.142111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.142776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.143063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.143336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.242114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:27.244081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d41eb-eafb-48e5-a240-74aa784e2afb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.265585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.268562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.317927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d8c9-82e9-4803-b56b-304b451fdcb2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.361998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.363023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.363403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.363778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.365267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:27.366943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038982bf-e8d4-4e6e-aac6-64318d70a99e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.369517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 173/344] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:27.370869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2aa5b-c363-4e97-b2ec-9138df119c41 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.371284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2aa5b-c363-4e97-b2ec-9138df119c41 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.371662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2aa5b-c363-4e97-b2ec-9138df119c41 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.377323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 174/345] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:27.379157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2aa5b-c363-4e97-b2ec-9138df119c41 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.383097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 172/346] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:27.389293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.389712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.390084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.409793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:27.411223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:27.513080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 173/347] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:27.514697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.529089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2aa5b-c363-4e97-b2ec-9138df119c41 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.580433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.581609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.582089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.582569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.585556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.586959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.590198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:27.592161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.594108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 175/348] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:27.595095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.663157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4ab14-b9a6-4d62-b76c-e073bad2f6cb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.701256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.702129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.702418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.702701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.704738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:27.706225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.707947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 174/349] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:27.709970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.731353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1735-147d-4178-8d71-b312e9efd3b5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.769265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.770137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.770428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.770764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.784723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d249879e-8837-459c-a99a-c4753bebd647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:27.793336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:27.794294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:27.795151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 176/350] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:27.796341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e29e-703a-4b19-80fe-8cb92edca7fc None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.801735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e29e-703a-4b19-80fe-8cb92edca7fc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.802042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e29e-703a-4b19-80fe-8cb92edca7fc None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.803498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 177/351] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:27.804256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e29e-703a-4b19-80fe-8cb92edca7fc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:27.822679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258192-8f91-4e2c-9fc9-38c75680c012 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:27.848287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.863198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:27.864413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.864706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.865274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.866124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:27.866701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:27.869243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1edc4-09b0-434d-8b9e-0e0ecf0f0026 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:27.877511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 175/352] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:27.878991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:27.879387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:27.879774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:27.887398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:27.913298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:27.914906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:28.000797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 176/353] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:28.001687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.012948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e29e-703a-4b19-80fe-8cb92edca7fc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.119761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.120867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.121156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.121434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.128155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.129759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.131984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 178/354] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:27 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.132803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.141654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8dca2-5c99-495a-b551-3ef100fa2526 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.152140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:28.200136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.201105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.201386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.201659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.202407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:28.202711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.204091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.218866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 177/355] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.219812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.254072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a7b8-007e-46fe-a906-512846098500 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.284466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:28.301013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.301836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.302126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.302416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.328668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:28.345980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:28.348508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 179/356] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:28.350568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.356292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50519c33-b836-41a2-b379-31b1a8d6ca07 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.406288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.406878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.407164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.407448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.408309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:28.408628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.416848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.423324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 178/357] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.424150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.482302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:28.483061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0c8d0-2cd8-4a39-bd8d-cbd535588e30 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.533626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.534549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.534839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.535122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] PATH_INFO: `/v3/users/2bd0548866684339a8cda82a628b2cc6` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.536716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd0548866684339a8cda82a628b2cc6)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.538346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf93d-ae20-4527-a76a-cf3c824f6f09 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.543918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 180/358] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/users/2bd0548866684339a8cda82a628b2cc6 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.545125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296591-2ce1-46f4-9472-35ffcbdd39f3 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.545417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296591-2ce1-46f4-9472-35ffcbdd39f3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.545699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296591-2ce1-46f4-9472-35ffcbdd39f3 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.551170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 181/359] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:28.554948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296591-2ce1-46f4-9472-35ffcbdd39f3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.642233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aec68-3a9d-4dbf-8487-8b4e7b67914e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.668818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:28.709233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.709915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.710520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.710803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.712137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:28.713143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.715218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c86838-4188-4a0c-8584-62fb5ecfdefa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.722739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296591-2ce1-46f4-9472-35ffcbdd39f3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.737849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 179/360] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.739432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e024f3-370c-4741-b89a-c29d1110d8f0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.739692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e024f3-370c-4741-b89a-c29d1110d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.740076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e024f3-370c-4741-b89a-c29d1110d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.763149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-92e024f3-370c-4741-b89a-c29d1110d8f0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:28.764538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-92e024f3-370c-4741-b89a-c29d1110d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:28.766619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:28.767443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.767865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.768311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.769292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] RBAC: Adding query filter params (role.id=86d992267dda443fb9c42df5d9134143, user.id=2bd0548866684339a8cda82a628b2cc6, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:28.769764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:28.771468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9f5e2-6808-4851-a3da-68818a7adc4e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:28.785528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 182/361] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/role_assignments?user.id=2bd0548866684339a8cda82a628b2cc6&scope.system=all&role.id=86d992267dda443fb9c42df5d9134143 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:28.787209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718ad0-6d1d-482e-bf1a-5c901e3e71ce None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.787642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718ad0-6d1d-482e-bf1a-5c901e3e71ce None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.788087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718ad0-6d1d-482e-bf1a-5c901e3e71ce None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.789956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 183/362] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:28.790938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718ad0-6d1d-482e-bf1a-5c901e3e71ce None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:28.860732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 180/363] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:28.863630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:28.863926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:28.864226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:28.906681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:28.909364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:28.949501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:28.957297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718ad0-6d1d-482e-bf1a-5c901e3e71ce None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:28.986889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.020837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.021668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.021962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.022239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.031370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 181/364] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:29.032285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.134510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.136133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:29.159974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791bec-cfc1-47ad-9685-a66e04e64a46 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.204581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.205609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.205902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.206186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.221717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:29.231431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:29.233492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 182/365] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:29.235556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.261984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.284327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 184/366] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:29.285203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.303999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.382941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7086-c43c-49ec-97db-cd8b9408071c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.412683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d791c9-bada-4482-932a-02d6a81e05a4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.441839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.442650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.442937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.443217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.460304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.460911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.461207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.461490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.462205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:29.462381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:29.462654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.464058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:29.471548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:29.473806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 183/367] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:29.476257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.481846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 185/368] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:29.481846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.573281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.577868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.605677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d411-ea19-4cc6-9fbc-9ee531524a5c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.606800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5c14-7354-4427-a00e-44088c7109d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.656680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.657361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.657651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.657935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.658692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:29.659007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.660466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:29.662952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.664045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.664568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.665067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.667013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.669529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:29.671106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 186/369] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:29.671951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.672178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 184/370] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:29.676219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:29.804798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128810-af9b-45e1-9d84-e242a34b74e3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.810504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314e04-8051-4856-bc7e-20ce9ebb6e00 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:29.847619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.848683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.849172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.849662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.859919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:29.861178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:29.861488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:29.861778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:29.869742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.877248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:29.937052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.938906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:29.963881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:29.965427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.055805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 185/371] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:30.059332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.104359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 187/372] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:30.105538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.119424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.164150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.193023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee35f-a46f-4ee2-acbb-c49f33ebe983 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.233818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.235054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.235536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.236005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.237635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.239394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.241706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 186/373] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.242690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.248217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c801-6ef7-46d8-b543-79460ff50d45 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.285440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.286311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.286597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.286880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] PATH_INFO: `/v3/projects/48523caa484b4c96bfa97c6efa0edb26` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.288579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] RBAC: Authorizing `identity:get_project(project_id=48523caa484b4c96bfa97c6efa0edb26)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.289584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.291861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 188/374] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/projects/48523caa484b4c96bfa97c6efa0edb26 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.292713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.368509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ec04-28bb-4d92-87cc-ae550cac5395 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.384560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.403451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a42da-9689-4cb3-b9d9-cf645cda3c14 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.412963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.414040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.415629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.416154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.416654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.418137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.419798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.422109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 187/375] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.423081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.444409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.445089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.445380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.445669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.446521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=92f3e1feec5443f3b44652af1386f05d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:30.447712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.449722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee83e-44b1-419b-a0bb-77249155d339 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.455908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 189/376] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.457296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732357-a448-46f0-bc82-aa2e01a3459c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.457602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732357-a448-46f0-bc82-aa2e01a3459c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.457884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732357-a448-46f0-bc82-aa2e01a3459c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.459470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 190/377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:30.460144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732357-a448-46f0-bc82-aa2e01a3459c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.541364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c6ac-1945-4743-9691-8016e701a43b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.579559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732357-a448-46f0-bc82-aa2e01a3459c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.583141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.584418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.584910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.585408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] PATH_INFO: `/v3/groups/1d5776a48511469dbb7c310b6df50051` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.593455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] RBAC: Authorizing `identity:get_group(group_id=1d5776a48511469dbb7c310b6df50051)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.595323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9f432-a2ce-49eb-bf0a-65a8f5986d6e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.597785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 188/378] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/groups/1d5776a48511469dbb7c310b6df50051 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.599387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.599939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.600470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.620026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:30.621476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.621874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:30.622480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.622837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.623186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.624518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.627244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.629147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 191/379] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.632570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.687950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.690934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:30.731914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 189/380] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:30.733635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.779305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c129a3-ac03-4a46-8754-e4277c7217ec None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.833978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.834651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.835044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.835332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.836781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] RBAC: Adding query filter params (group.id=1d5776a48511469dbb7c310b6df50051, role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=48523caa484b4c96bfa97c6efa0edb26) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:30.837119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.839122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.847694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 192/381] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/role_assignments?group.id=1d5776a48511469dbb7c310b6df50051&scope.project.id=48523caa484b4c96bfa97c6efa0edb26&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:30.848570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:30.875279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8e30a-5931-42b0-8ac1-dad1d406c2b1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:30.927079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:30.929232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:30.930111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:30.930767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:30.932798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=92f3e1feec5443f3b44652af1386f05d) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:30.933323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:30.935649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d7628-ec1e-4336-88b0-91d772806303 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:30.942904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 190/382] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:31.017324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e473-218c-41cd-838d-36cb67dffae8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.019357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:31.026136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b85b6-c31f-4d26-ba34-c33fc9a5dab9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.026768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b85b6-c31f-4d26-ba34-c33fc9a5dab9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.027059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b85b6-c31f-4d26-ba34-c33fc9a5dab9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.028626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 191/383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:31.036143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.036473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.036756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.070356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:31.072162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:31.092934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.093768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.094055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.094333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.116049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:31.127903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:31.128849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:31.130049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 193/384] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:31.142207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.148996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:31.199702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 192/385] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:31.231454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.316488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f64a6-5779-468c-92b7-7969efbef8c2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.357778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.358864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.359355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.359834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.360815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:31.361347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:31.362944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:31.374152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd081-2fe2-40b6-987b-086137d84484 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.375342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 194/386] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:31.393999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.416449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.417270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.417556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.417836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.429524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:31.441116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:31.442024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:31.443233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 193/387] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:31.449045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.457318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:31.482003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:31.564219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd488f-e9ce-459c-b414-6b948e395d46 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.595470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.596325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.596735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.597128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.597985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:31.598440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:31.599971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:31.609721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 194/388] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:31.615470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.666345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e5d8-f88b-4a15-8c66-bc7158c4020f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.719007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:31.730598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2dd9-c757-4813-b062-a518e324cad9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.769842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.770866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.771253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.771636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.773006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:31.774920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:31.777022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 195/389] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:31.783159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.802560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.803454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.803738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.804018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.805330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:31.806942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:31.817245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 195/390] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:31.837377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.911078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18180c0-ff45-4edb-b95d-ef58064a7577 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:31.956284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:31.957332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:31.957621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:31.957906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:31.959134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:31.960648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:31.963413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 196/391] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:31.969129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:31.984006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:32.002284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24211-c683-4bfb-86f8-1f607be6eb65 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:32.003552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:32.088143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330ef7d-b3e8-4066-95c5-42918c20a9c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:32.127041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:32.128392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:32.129453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:32.129951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:32.130386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:32.130668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/groups/a68659288acf46cd998390c91027aad9/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:32.131306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:32.131594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:32.133331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:32.134866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:32.136753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 196/392] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:31 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:32.141023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, group_id=a68659288acf46cd998390c91027aad9, role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:32.142502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d2d8b-22a7-4c20-9bc0-c45501fd77c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:32.147835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:32.167233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 197/393] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 20 13:33:31 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/groups/a68659288acf46cd998390c91027aad9/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:32.269905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f6c41-b0e9-406a-bd89-825edf1da021 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:32.307662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:32.308646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:32.308942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:32.309227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/groups/a68659288acf46cd998390c91027aad9/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:32.311324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4, group_id=a68659288acf46cd998390c91027aad9, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:32.313037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d28a9-ca73-43a8-bb57-53b48be56282 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:32.331154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 197/394] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 20 13:33:32 2022] PUT /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4/groups/a68659288acf46cd998390c91027aad9/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:32.870673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b88e4e-0d0b-4b1a-8fa6-ec7320f410e9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:32.871697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b88e4e-0d0b-4b1a-8fa6-ec7320f410e9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:32.872226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b88e4e-0d0b-4b1a-8fa6-ec7320f410e9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:32.874081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 198/395] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:32.879009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:32.879543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:32.880032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:32.904321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:32.905885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:32.922590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:32.992640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 198/396] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:33.028561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b88e4e-0d0b-4b1a-8fa6-ec7320f410e9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:33.162395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:33.189843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b88e4e-0d0b-4b1a-8fa6-ec7320f410e9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:33.234836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:33.236028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.236560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.237037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.248721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:33.261617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:33.262544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:33.263328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 199/397] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:33.268739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:33.429328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff448bdf-7756-4a90-ad7d-4f096650b56b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:33.469775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:33.470463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.470749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.471023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.471777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:33.472088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:33.473494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:33.488076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 199/398] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:33.493781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:33.614938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fb0f4-41dd-408b-b886-923ff5b90c9a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:33.673037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:33.673905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.674198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.674478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.681525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:33.683000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cef7-de52-4f49-a1db-9839b4dc4351 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:33.685004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 200/399] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:33 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:33.690521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:33.702026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6091bf-a37a-4108-a225-a44f83a80dbe None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.702314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6091bf-a37a-4108-a225-a44f83a80dbe None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.702599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6091bf-a37a-4108-a225-a44f83a80dbe None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.705946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 201/400] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:33.710052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df5901-48e9-4e28-9296-a21538c18154 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.710570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df5901-48e9-4e28-9296-a21538c18154 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.710967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df5901-48e9-4e28-9296-a21538c18154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.714488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:33.738927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-71df5901-48e9-4e28-9296-a21538c18154 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:33.740777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-71df5901-48e9-4e28-9296-a21538c18154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:33.755714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:33.836553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 202/401] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:33.838768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d1d6-d572-4673-a1ba-bd2a4d518560 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.839063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d1d6-d572-4673-a1ba-bd2a4d518560 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.839341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d1d6-d572-4673-a1ba-bd2a4d518560 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.843210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 203/402] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:33.848537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.848967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.849339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.850405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b734-6457-4625-abf7-26bd6816f482 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:33.873101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:33.874458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:33.921157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:33.922046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:33.922330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:33.922607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:33.923958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:33.926085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:33.930145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 200/403] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:33 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:33.931065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:33.971971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 204/404] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:33.973150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.026223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.047596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f0f9-76ac-49e9-8d84-c278767444e2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.054411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.083085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb47d4f-796b-43c5-9da3-5232934e458a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.084979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.085929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.086324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.086702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.099399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:34.109498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:34.110581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:34.111588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:34.113751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 201/405] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:34.114798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.126302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.127516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.127944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.128397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/groups/a68659288acf46cd998390c91027aad9/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.130627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, group_id=a68659288acf46cd998390c91027aad9, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.132569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.148650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 205/406] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 20 13:33:33 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/groups/a68659288acf46cd998390c91027aad9/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:34.150097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.230515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289937-597d-445c-904e-4b26cf600ecd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.272946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.273773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.274111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.274397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.290764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.293940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd5f8-311b-4e61-b435-ed6fbb53324d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.297992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:34.305998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:34.306863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:34.307647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:34.308270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 202/407] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:34.313302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.352613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.353836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.354353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.354879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.355843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:34.356414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.358098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.360048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.375040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 206/408] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:34.380961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.440591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0a2-8d49-4ce1-b1c2-3a5346aedfdb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.477789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.478516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.478806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.479133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.479962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:34.480321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.481885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.491064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 203/409] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:34.497455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.521551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39101e1-efb7-4f07-8c4c-91a0c64845d8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.565297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.566517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.566994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.567419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.569692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.571198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.573027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 207/410] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:34.578314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.578738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.643075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6287f-0b3d-4b15-9443-3a5fd5e550c3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.680700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.716730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.717604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.718816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.719061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] PATH_INFO: `/v3/groups/1d5776a48511469dbb7c310b6df50051` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.720421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] RBAC: Authorizing `identity:get_group(group_id=1d5776a48511469dbb7c310b6df50051)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.723167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.725969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 204/411] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/groups/1d5776a48511469dbb7c310b6df50051 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:34.730683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.755194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25bb-0ffe-4172-b07f-08660591b80b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.826202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.827118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.827407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.830007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.831268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.832756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.834483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 208/412] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:34.840383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:34.924039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c94422-d381-4046-ae90-25762e2b02dc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:34.975374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:34.982935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:34.988326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:34.988326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:34.988326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] PATH_INFO: `/v3/projects/48523caa484b4c96bfa97c6efa0edb26` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:34.989584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] RBAC: Authorizing `identity:get_project(project_id=48523caa484b4c96bfa97c6efa0edb26)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:34.994711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:34.998417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 205/413] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:34 2022] GET /identity/v3/projects/48523caa484b4c96bfa97c6efa0edb26 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:35.004258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.043297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2c9a-3d2b-4fb3-8865-214d6f4ef2aa None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.083255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:35.090486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.091630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.092096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.092577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d/groups/a68659288acf46cd998390c91027aad9/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.095570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] RBAC: Authorizing `identity:create_grant(project_id=92f3e1feec5443f3b44652af1386f05d, group_id=a68659288acf46cd998390c91027aad9, role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:35.097707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61afd-d40b-48bd-8088-12873bbe4328 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:35.115800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 209/414] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 20 13:33:34 2022] PUT /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d/groups/a68659288acf46cd998390c91027aad9/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:35.117822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff168c10-7fef-4be3-b24e-46de82a3095a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.119153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff168c10-7fef-4be3-b24e-46de82a3095a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.120099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff168c10-7fef-4be3-b24e-46de82a3095a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.122114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 210/415] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:35.126589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cb6e0-1144-4cca-9298-1857e1cc3290 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.129224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e4a-8d2c-40b5-9617-5418f9edd43b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.129512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e4a-8d2c-40b5-9617-5418f9edd43b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.129787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e4a-8d2c-40b5-9617-5418f9edd43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.155026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-40ef4e4a-8d2c-40b5-9617-5418f9edd43b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:35.157010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-40ef4e4a-8d2c-40b5-9617-5418f9edd43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:35.170439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.171382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.171667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.171975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] PATH_INFO: `/v3/projects/48523caa484b4c96bfa97c6efa0edb26/groups/1d5776a48511469dbb7c310b6df50051/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.174256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=48523caa484b4c96bfa97c6efa0edb26, group_id=1d5776a48511469dbb7c310b6df50051, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:35.175714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:35.196492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 206/416] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 20 13:33:35 2022] PUT /identity/v3/projects/48523caa484b4c96bfa97c6efa0edb26/groups/1d5776a48511469dbb7c310b6df50051/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:35.242349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 211/417] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:35.271210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.372390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:35.381755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f500bbe-f5bf-435f-a365-d6defeb421a9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.382076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f500bbe-f5bf-435f-a365-d6defeb421a9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.382365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f500bbe-f5bf-435f-a365-d6defeb421a9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.384210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 212/418] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:35.389563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.389867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.390160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.409860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146647f9-6314-4807-8249-a5d24e3e48f8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.420734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:35.422008 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:35.456139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.457467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.457846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.458201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.469422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:35.479715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:35.480682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:35.481481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:35.482077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 207/419] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:35.489200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.512368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 213/420] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:35.539509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.608589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:35.650848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e63e-7741-40b0-b5f8-3c7cc1ffa3d2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.674227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e884556-a6b9-4869-b1a9-cb6fecf70c26 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.692322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.693574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.694068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.694603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.706644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:35.709026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:35.718338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:35.719306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:35.720090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:35.722903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 214/421] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:35.731544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.747869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.748584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.748900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.749476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.750018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:35.750335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:35.751728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:35.771868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 208/422] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:35.777561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.847810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6763b-4b5a-4ac5-9770-610082b96a04 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:35.863274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:35.891532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:35.892239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:35.892538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:35.892822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:35.893581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:35.893894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:35.895301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:35.911601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 215/423] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:35.919191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:35.976014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78955586-0441-4eb2-bc4a-678f4d0b2805 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.025900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.026571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.027300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.027590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.081930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.104762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.106729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.176468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f413-1b77-49f4-87a0-2804b9555140 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.242762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.243440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.243723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.243998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.257777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 209/424] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:36.263585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.345316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.368604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.392178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.393739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.405033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7412b-c5d7-4da3-a71e-e8fbb4128845 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.463985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.464792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.465076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.465354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.466643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.468099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.469816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 210/425] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:36.475841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.591915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cee22-0a2b-4ca4-a5e3-d2db67f50648 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.623972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 216/426] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:36.629437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.647719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.648623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.648913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.649194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.650993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.652484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.659045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 211/427] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:36.659894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.679983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.709752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.739057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ba50-1a40-4cec-a18e-9c934c755d41 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.784743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e439e3b-21da-4096-befb-480ba0ec5ccf None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.813808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.814680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.814999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.815231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] PATH_INFO: `/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.816442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8a3a4be1114bf4ac2a9678bb1de3d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.818044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.824364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 217/428] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/projects/4a8a3a4be1114bf4ac2a9678bb1de3d4 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:36.825778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.830170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.831090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.831591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.832062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.833133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:36.833744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.835396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b17306-9d49-4d6b-b0bb-c39f5c6332b2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:36.842785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 212/429] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:36.844368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eda1-3043-44a3-bdc4-a491ae0d0aed None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.844864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eda1-3043-44a3-bdc4-a491ae0d0aed None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.845366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eda1-3043-44a3-bdc4-a491ae0d0aed None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.846878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 213/430] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:36.853923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.854543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.855030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.873714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:36.875324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:36.937118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896a5bd-d510-4e0c-a1d2-63ffd5d4ca63 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:36.950055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 214/431] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:36.974779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:36.987877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:36.988098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:36.989337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:36.989719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:36.990321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:36.993862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:36.998262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:37.004282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 218/432] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:37.016169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.037095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:37.105230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684102-202b-44f0-8705-acea6fa6ba8d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:37.153097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:37.153905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.154198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.155406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.163475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7deb-8eec-4f7b-8b40-fac1ca1c813c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:37.168516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:37.177808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:37.178702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:37.181987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 215/433] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:37.184734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.213673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:37.214224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.214488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.214771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.215614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:37.215983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:37.219196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:37.226001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 219/434] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=4a8a3a4be1114bf4ac2a9678bb1de3d4&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:37.274478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:37.311107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb26-1fed-4b75-8c19-de356c951b3a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:37.350638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:37.351719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.352219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.352725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.353694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:37.354221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:37.355828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:37.366245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 216/435] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:37.372109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.460581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:37.488941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed23a9-ea11-4f41-a5b5-dcd42dc7deb6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:37.524107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:37.525368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.525599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.525872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.600690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:37.602150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be4f1-2511-4af5-ba0e-1e30005c2bc7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:37.678777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:37.709560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 220/436] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:37.714747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.722031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce6ce-97e8-4d60-a83f-f05049d98871 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.722327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce6ce-97e8-4d60-a83f-f05049d98871 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.722618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce6ce-97e8-4d60-a83f-f05049d98871 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.725976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 221/437] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:37.730322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134769d-3aec-4c00-8f3c-243f700a1839 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.730609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134769d-3aec-4c00-8f3c-243f700a1839 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.730894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134769d-3aec-4c00-8f3c-243f700a1839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.750294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d134769d-3aec-4c00-8f3c-243f700a1839 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:37.751506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d134769d-3aec-4c00-8f3c-243f700a1839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:37.832289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 222/438] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:37.833747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42045b1-8a44-4218-a8b9-4f14891be8eb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.833863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42045b1-8a44-4218-a8b9-4f14891be8eb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.834139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42045b1-8a44-4218-a8b9-4f14891be8eb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.835562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 223/439] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:37.836855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02453a-9703-40a5-a73a-27e974b55fe5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:37.842173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513707-3ede-469a-8d24-8c591da55238 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.842465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513707-3ede-469a-8d24-8c591da55238 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.842752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513707-3ede-469a-8d24-8c591da55238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.865649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-50513707-3ede-469a-8d24-8c591da55238 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:37.867212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-50513707-3ede-469a-8d24-8c591da55238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:37.880259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:37.887883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:37.888816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:37.889104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:37.889385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:37.890670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:37.892496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:37.894655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 217/440] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:37.897069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.949067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 224/441] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:37.949916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50513707-3ede-469a-8d24-8c591da55238 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:37.984183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.001684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7b19-dc85-4279-acc4-22c05ac7eb05 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.037472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.038701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.038994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.039435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.049965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50513707-3ede-469a-8d24-8c591da55238 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.050091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:38.058741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:38.059703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:38.060704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 218/442] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:38.061536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.088106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.088925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.089208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.089487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.090666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.092124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.093776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 225/443] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:37 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:38.094536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.120435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.160975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca4b-4ab5-4c98-a6ce-63cb43b9dac1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.194034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.194820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.195100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.195373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.196267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e773-3c75-4529-baa8-011291d6e7a7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.197838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.206379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:38.215354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:38.216270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:38.217056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 219/444] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:38.217703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.235185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.235847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.236133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.236443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.237197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:38.237505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.238877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.247201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 226/445] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:38.247991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.319339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503704b-65da-4248-b463-7723ee20e3c7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.339518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.348776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42363-7373-4408-9228-f0c9645a27e1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.354168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.354815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.355101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.355379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.356212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=eb9da8ce88ff4b8880fa8fb43b026333, scope.project.id=92f3e1feec5443f3b44652af1386f05d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:38.356534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.357967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.363606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 220/446] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=eb9da8ce88ff4b8880fa8fb43b026333 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:38.364398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.405997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.406933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.407370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.408011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.410670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:38.412170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.413725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.424237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 227/447] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:38.429849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.459647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.487708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55db8-2cc7-42ef-b86d-f2d365a2c266 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.526536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.527569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.527863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.528149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.550148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf345-40ec-4ef9-9b37-ae9c646656b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.593522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.596120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.596807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.597091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.597367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.615995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.617627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.683896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.685448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.718424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.736182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 221/448] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:38.741952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.793594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 228/449] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 13:33:38.799161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.827219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.844453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1b10-2e7f-4f9f-a5d2-d09db3c126f0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.878693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.879546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.879832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.880110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] PATH_INFO: `/v3/projects/92f3e1feec5443f3b44652af1386f05d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.881324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] RBAC: Authorizing `identity:get_project(project_id=92f3e1feec5443f3b44652af1386f05d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.882761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.884702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 222/450] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/projects/92f3e1feec5443f3b44652af1386f05d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:38.890098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.894879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc5da8-012e-45cf-b6ef-58763bf899e2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:38.921378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:38.930835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:38.931692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:38.931979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:38.932293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] PATH_INFO: `/v3/projects/48523caa484b4c96bfa97c6efa0edb26` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:38.933474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] RBAC: Authorizing `identity:get_project(project_id=48523caa484b4c96bfa97c6efa0edb26)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:38.934938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:38.936655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 229/451] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/projects/48523caa484b4c96bfa97c6efa0edb26 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:38.941992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:38.985998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1156e-38f1-4f59-b47d-100d36e24b29 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:39.019344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:39.020181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:39.020483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:39.020760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] PATH_INFO: `/v3/groups/a68659288acf46cd998390c91027aad9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:39.021922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] RBAC: Authorizing `identity:get_group(group_id=a68659288acf46cd998390c91027aad9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:39.023364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:39.025521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 223/452] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/groups/a68659288acf46cd998390c91027aad9 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:39.031270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:39.041161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb479-9867-4867-88ee-9cca878e57c2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:39.051490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:39.074794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:39.075909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:39.076206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:39.076492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] PATH_INFO: `/v3/groups/1d5776a48511469dbb7c310b6df50051` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:39.077662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] RBAC: Authorizing `identity:get_group(group_id=1d5776a48511469dbb7c310b6df50051)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:39.079104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:39.080755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 230/453] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 20 13:33:38 2022] GET /identity/v3/groups/1d5776a48511469dbb7c310b6df50051 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:39.086522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:39.129073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e6d87-53e1-453a-b018-778e78e50cc6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:39.145378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:39.162964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:39.163614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:39.163903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:39.164203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:39.165052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] RBAC: Adding query filter params (group.id=a68659288acf46cd998390c91027aad9, role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=92f3e1feec5443f3b44652af1386f05d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:39.165968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:39.167431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e916f67-9261-45e3-a3b4-81aeae0abfff None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:39.173194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 224/454] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:39 2022] GET /identity/v3/role_assignments?group.id=a68659288acf46cd998390c91027aad9&scope.project.id=92f3e1feec5443f3b44652af1386f05d&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:39.184862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2f8d-e960-4252-85d5-70157f28f7d4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:39.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:39.222113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:39.222401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:39.222683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:39.223542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] RBAC: Adding query filter params (group.id=1d5776a48511469dbb7c310b6df50051, role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=48523caa484b4c96bfa97c6efa0edb26) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:39.223858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:39.225389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdd49-8427-4a11-970b-76c44d82700f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:39.232732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 231/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 20 13:33:39 2022] GET /identity/v3/role_assignments?group.id=1d5776a48511469dbb7c310b6df50051&scope.project.id=48523caa484b4c96bfa97c6efa0edb26&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:41.722046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ad6a-6787-45ad-8e1c-19cffb0ed1e9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:41.722551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ad6a-6787-45ad-8e1c-19cffb0ed1e9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:41.722659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ad6a-6787-45ad-8e1c-19cffb0ed1e9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:41.724273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 225/456] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:41.730295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039883-086b-4986-ad99-99303cd7fe50 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:41.730729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039883-086b-4986-ad99-99303cd7fe50 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:41.730848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039883-086b-4986-ad99-99303cd7fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:41.757124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a4039883-086b-4986-ad99-99303cd7fe50 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:41.758529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a4039883-086b-4986-ad99-99303cd7fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:41.845579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 232/457] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:41.881380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ad6a-6787-45ad-8e1c-19cffb0ed1e9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.001075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4363-f4fe-487d-84c4-43703c37ae25 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.001637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4363-f4fe-487d-84c4-43703c37ae25 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.002146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4363-f4fe-487d-84c4-43703c37ae25 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.004440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 233/458] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:42.012769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.020083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f65ff-31a1-4a5e-b1e7-33b9ce87d791 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.020793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f65ff-31a1-4a5e-b1e7-33b9ce87d791 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.021373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f65ff-31a1-4a5e-b1e7-33b9ce87d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.050520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ad6a-6787-45ad-8e1c-19cffb0ed1e9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.054832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b05f65ff-31a1-4a5e-b1e7-33b9ce87d791 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:42.061535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b05f65ff-31a1-4a5e-b1e7-33b9ce87d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:42.126114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.127310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.127797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.128305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.139488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.141556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.144863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-75e509ea-7860-4106-957d-16fbc9e7d87c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:42.163871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:42.164793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:42.165700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:42.165700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:42.165700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.165700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:42.165915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 234/459] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:42.166775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93154813-4a13-487a-90e8-66566ceda1a6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.167271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93154813-4a13-487a-90e8-66566ceda1a6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.167681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93154813-4a13-487a-90e8-66566ceda1a6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.169102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 235/460] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:42.174051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 226/461] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:42.179570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93154813-4a13-487a-90e8-66566ceda1a6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.193999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.194537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.195387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.217818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:42.219349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:42.300305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 227/462] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:42.301539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.312421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93154813-4a13-487a-90e8-66566ceda1a6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.359239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.360387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.360894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.361419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.362343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:42.362849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.364551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.382232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 236/463] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:42.383447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.400671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.437599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.453052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d3648-393a-4b07-b859-dc61236b0406 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.493830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.494936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.495454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.495913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.497285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3538c-ad65-46f8-acf9-5902c70a6949 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.507104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.509419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:42.528154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:42.529029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:42.529867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:42.529867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:42.529867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.529867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:42.536442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 228/464] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:42.537514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.539311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.540643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.540934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.541216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.553619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.555050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:42.573252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:42.574125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:42.575413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:42.575413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:42.575413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:42.575413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:42.579388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 237/465] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:42.580271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.660991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51557e1-71a3-4e4f-989f-81155691a428 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.682701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.682920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:42.688131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c67545-fd96-4065-b0ad-fe4bdf43cbfe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.702669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.703342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.703636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.703922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.704677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.706123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.726697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.727111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 229/466] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:42.728502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.728857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.729208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.729744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.730349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:42.730757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.732233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d6ae4-60ae-4de0-b7c5-c1c71e766584 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.751395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 238/467] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:42.751395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba254-0c60-4e05-97be-5f96cf39b8b3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.751395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba254-0c60-4e05-97be-5f96cf39b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.751395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba254-0c60-4e05-97be-5f96cf39b8b3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.751395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 239/468] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:42.754071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba254-0c60-4e05-97be-5f96cf39b8b3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.868758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1680d-191e-46ab-aa41-b99ff4fd36c5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.883618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba254-0c60-4e05-97be-5f96cf39b8b3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:42.915235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.916112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.916463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.916751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.917499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:42.917819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.919778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2534d8-a6ba-4b2b-912b-7e56cbbf12d0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.939431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 230/469] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:42.939621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:42.939621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.939821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:42.939913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.939994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:42.940073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.940150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:42.940258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:42.940673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:42.962555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:42.964125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:42.967297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 240/470] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:33:42.972325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:42.990381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.018778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.075357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 231/471] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:43.101445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:43.129072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf9e5-83df-4983-81f4-229769c4aca4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.169281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.170441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.170938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.171468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.172529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:43.174195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab73a0-557e-43b2-88e8-d09c354cc488 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:43.199120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 241/472] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:42 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:43.240447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff552a5-300c-40c8-a8fd-307b1a812723 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.278814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-3a08-41f3-9698-751f5c713b80 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.279456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-3a08-41f3-9698-751f5c713b80 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.279994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-3a08-41f3-9698-751f5c713b80 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.282036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 242/473] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:43.287382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.287874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.288347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.289702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.291042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.291327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.291599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.310737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:43.311294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:43.312681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:43.313720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:43.344409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:43.345332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:43.346158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:43.346158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:43.346158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:43.346158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:43.346158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 232/474] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:43.352826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:43.390578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.409529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.418007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 243/475] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:43.444814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:43.494927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfcfab-15fb-4bc1-aaaf-736dbb6f67cf None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.535209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.535873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.536148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.536518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.537253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:43.537562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:43.538954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:43.554213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 233/476] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:43.561300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:43.597846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919637-db8e-4a7a-9a7e-f9bcbb7dd247 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.663952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.664588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.664875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.665207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.665974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:43.667400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:43.676244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 13:33:43.676244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 13:33:43.676244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [parameters: {'id': '9bbbed872cc84994b553a825c1224f02', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 13:33:43.676244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 13:33:43.684280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 20 13:33:43.694982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:33:43.696101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 13:33:43.697372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 13:33:43.698361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:33:43.699631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:33:43.702628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'id': '9bbbed872cc84994b553a825c1224f02', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:43.703599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 13:33:43.706787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.707792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 244/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 20 13:33:43 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:43.710041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:43.723701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f874-3a11-47f4-95d6-b240dbccfabf None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.766698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.768046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.768614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.769165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.770035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:43.771621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:43.797273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 234/478] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:43 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:43.839399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:43.905778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465305-6f5d-476e-8889-43172a635e9c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:43.956182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:43.956927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:43.957212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:43.957483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:43.977351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b9e50120-5d2d-4e2f-af62-fce83e74904e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:43.985586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:43.986491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:43.987278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 245/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:33:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:43.992522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:44.114788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae49a-d941-4b58-b8a9-d277ef70f030 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:44.150563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:44.157471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:44.158456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:44.158944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:44.159445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:44.160440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:44.160980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:44.162587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9f8f-2f74-4151-bf7c-b28d84a3b3a7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:44.172364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 235/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:45.277705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203fb2-0eef-4709-a044-963b8b140a7a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.278227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203fb2-0eef-4709-a044-963b8b140a7a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.278318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203fb2-0eef-4709-a044-963b8b140a7a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.279873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 246/481] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:45.285232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6a962-3135-4178-8f1d-6ec187d5c3b8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.285640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6a962-3135-4178-8f1d-6ec187d5c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.285808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6a962-3135-4178-8f1d-6ec187d5c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.309216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c4c6a962-3135-4178-8f1d-6ec187d5c3b8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:45.310571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c4c6a962-3135-4178-8f1d-6ec187d5c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:45.385308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 236/482] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:45.420643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1203fb2-0eef-4709-a044-963b8b140a7a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:45.557895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1203fb2-0eef-4709-a044-963b8b140a7a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:45.595198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:45.599984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:45.600803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.601085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.601359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.616968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:45.619877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66f0fc-b579-47be-b8ac-5fa3623b74b1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.620168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66f0fc-b579-47be-b8ac-5fa3623b74b1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.620555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66f0fc-b579-47be-b8ac-5fa3623b74b1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.622230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 237/483] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:45.625785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:45.626636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:45.627413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:45.628003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.628003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.628003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.628179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 247/484] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:45.635168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:45.668575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:45.669765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:45.788671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 238/485] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:45.799333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016e3c2-79fb-4858-ae76-34cf3816ea03 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:45.824157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:45.860886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:45.861952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:45.862445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:45.862934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:45.863890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:45.864936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:45.867594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:45.884769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 248/486] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:45.892962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:45.925230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:45.976091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:45.990545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970475ed-6fb9-42ab-a935-b3c7948cafac None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.028170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.029406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.029694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.029974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.041127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:46.042274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cff31-af1f-457b-98b7-f9786fc29be8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-2cc001d2-c7a9-4db0-980b-cdafe15d19c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:46.049129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:46.050019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:46.050814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 239/487] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:46.058726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74bf8-4488-4fe1-aa0e-dbdaf40e2e54 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.058726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74bf8-4488-4fe1-aa0e-dbdaf40e2e54 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.058726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74bf8-4488-4fe1-aa0e-dbdaf40e2e54 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.058726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 240/488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:46.058726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a74bf8-4488-4fe1-aa0e-dbdaf40e2e54 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.098653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.099367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.099650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.099926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.114727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.116853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b1fe7a6e-10ff-4255-a5b1-63106bcc21f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:46.138801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:46.139650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:46.140951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:46.140951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:46.140951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:46.140951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:46.144273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 249/489] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:46.145754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.146045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.146329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.172725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:46.173948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:46.187613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a74bf8-4488-4fe1-aa0e-dbdaf40e2e54 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.207454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.234653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.235844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.236667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.237389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.238541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:46.239028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.241220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.251422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 241/491] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:46.251888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 250/491] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:46.252902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.257504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.304583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.371252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c0d4-fa6e-4bae-87e9-971820946175 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.403144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6935-7e81-4850-8690-621034a84f00 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.409991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.410738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.411102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.411458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.412315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:46.412702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.414180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.427338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 242/492] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:46.428465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.454503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.456155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.456637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.457347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.470965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.473542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.475208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:46.499093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:46.499986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:46.500851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:46.500851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:46.500851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:46.500851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:46.504287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 251/493] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:46.505199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.552358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b3ff-5b23-4e39-bdf7-5f829c99d3f4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.589971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.590735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.590846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.591042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.591319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.602296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8e376036-ce9a-448e-a40c-6196e0f57d41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:46.610915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:46.611837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:46.612669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:46.613297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15abbc-39f1-4999-9b7d-486f54991f82 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.616838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 243/494] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:46.618258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e0f3-0bb5-40bd-a8e7-844726c41f90 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.618550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e0f3-0bb5-40bd-a8e7-844726c41f90 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.618830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e0f3-0bb5-40bd-a8e7-844726c41f90 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.620215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 244/495] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:46.620830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e0f3-0bb5-40bd-a8e7-844726c41f90 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.652015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.652829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.653113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.653385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.660887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.662341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:46.677782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:46.678821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 252/496] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:46.679717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.737579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.745662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e0f3-0bb5-40bd-a8e7-844726c41f90 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.780917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.781591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.781884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.782194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.782923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:46.783237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.784705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004bfc3-f1d8-4b18-a211-d24f398988ec None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.792432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf0a5-6a24-4998-80d4-3864fe63aef6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.796290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 245/497] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:46.797538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.797832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.798113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.814341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:46.815552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:46.836705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.837548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.837841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.838120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.838875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:46.839184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.840613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:46.854358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 253/498] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:46.854358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.857546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.894143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 246/499] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:46.895003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:46.960874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f852b9-fd31-4417-a4f7-aac9446d1198 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.978816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:46.993491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771855f-db8f-4420-9003-27bc0eccd81a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:46.994594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:46.995268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:46.995558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:46.995840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:46.996719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:46.997034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:46.998498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.026413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.027203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.027493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.027763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.034598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 254/500] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:47.034728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.035422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.036178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e4634a9e-c67e-498a-9eb0-97befe14570a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:47.054505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:47.055447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:47.056452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 247/501] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:47.057012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120dade-39ca-40b8-ab88-47adb8ff1136 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.061739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120dade-39ca-40b8-ab88-47adb8ff1136 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.061739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120dade-39ca-40b8-ab88-47adb8ff1136 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.061739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 248/502] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:47.061739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120dade-39ca-40b8-ab88-47adb8ff1136 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.099160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.140870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3aa6-4030-4fc8-8ad7-3ce01f49cace None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.161240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120dade-39ca-40b8-ab88-47adb8ff1136 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.175549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.176366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.176653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.176930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.186673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.188136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.194370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.195158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.195449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.195760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:47.205476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:47.206298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:47.207161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:47.207161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:47.207161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:47.207161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:47.207387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:47.207464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 255/503] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:47.207464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:47.214270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:47.215801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 249/504] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:47.218185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.229924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.312215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fba8d-8307-4e4e-9a4e-f7df8c643013 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.320921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2dca-e894-4e27-ae52-57b08ca5fbc5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.326572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.348376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.349028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.349317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.349591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.354570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.355235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.355522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.355803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.356676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:47.356989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.358451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dacf0f-b1c8-4dc1-a076-bc409830478b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.394329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 250/505] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:47.395573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.395863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.396146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.411740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:47.412895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:47.421000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.422475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.471317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.480437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 251/506] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:47.485071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.525745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 256/507] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:47.525745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.535892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.592160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd613ee-019b-428e-a634-628154f17c25 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.620847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5fe77-aaf0-4fed-83eb-bd8f3b286e9a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.625999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.626662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.626951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.627234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.627957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:47.628303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.629701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.641039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 252/508] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:47.641855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.659501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.660163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.660475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.660747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.661490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:47.661842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.663172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.671747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 257/509] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:47.672548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.701534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.745109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.746328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86d7f0-1a58-4792-bc46-83945ae3bb2d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.770684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510320c6-cb41-4374-aa24-6b0d459a22ab None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.779698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.780360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.780644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.780916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.803963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.804780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.805068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.805401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.815865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.817431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:47.835206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:47.836155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:47.837105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:47.837105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:47.837105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:47.837105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:47.837105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 258/510] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:47.837360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.855550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.857074 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:47.910257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.943352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cacd47-a4c3-472d-97eb-344d47b37597 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:47.960036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 253/511] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:47.960928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:47.970768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:47.980027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:47.980975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:47.981365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:47.981760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:47.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:47.994382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:48.011689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:48.012529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:48.013359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:48.013359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:48.013359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.013359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:48.013359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 259/512] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:48.013656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.064322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f7fc-7308-4aeb-aecb-884af2c206d3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.098485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.099277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.099566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.099845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.106918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.108414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.117055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8814-9bfc-46e8-b35d-eaa2519f7ebf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:48.123468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:48.124465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:48.125340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 254/513] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:48.125912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.140893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.157409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.158205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.158496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.158776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.170266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.171735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:48.189275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:48.190113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:48.190968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:48.190968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:48.190968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.190968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:48.190968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 260/514] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:48.191712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.222128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.230849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1530c-a3c7-4bd4-84cf-a03557758f08 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.264881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.265543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.265834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.266118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.266842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:48.267153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.268590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.280765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 255/515] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:48.281557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.292957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b31d-45bc-401f-934e-f9b032166c54 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.328285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.329087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.329377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.329656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.340340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.341780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.358101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:48.359346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:48.360414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:48.361264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:48.361264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:48.361264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:48.361264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:48.361264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 261/516] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:48.361531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.386319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc083a9-bebd-4e75-803e-cc91f176889e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.424469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.425131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.425477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.425758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.427094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:48.427826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.428884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.441306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 256/517] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:48.442299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.442798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.462551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b31c-009e-4008-84ee-eff07b19f00c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.495258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.495857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.496145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.496459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.497321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:48.497635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.499084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.516331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 262/518] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:48.517099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.551911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035c57-1514-41bd-9fb3-73cb1988c686 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.587750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.588437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.588721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.588991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.589705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:48.590014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.591397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.592861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.604313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 257/519] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:48.605024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.620735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3809f-5bb3-43aa-99ad-3febdce8dcbc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.658626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.659298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.659589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.659871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.660612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.662071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.671946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.683101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 263/520] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:33:48 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:33:48.687817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.710364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c929856-51c6-4da0-acc1-8e68e32a6d3a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.760916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.761595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.761890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.762173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.763600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:48.763920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.765865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.780750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 258/521] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:48.781630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.838578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52502ee1-60a8-448d-8648-d19e5e78fdd9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.850162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:48.882999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.883893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.884264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.884554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.892611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:48.894082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:48.904326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac2c5-d639-4bbe-9225-7b45173c91f4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:48.909905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:48.910768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:48.911605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 264/522] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:48.912620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:48.942412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:48.943133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:48.943431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:48.943754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:48.975129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.016593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.018147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.024081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92234d94-8d8d-4ee2-b896-c1c8afc80938 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.074899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.075912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.077584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.077857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.078280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.087352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.088860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:49.105106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:49.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:49.107037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 265/523] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:49.107590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.136421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 259/524] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:49.136421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.218175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766433db-9453-45fb-b2f3-ff0eb9215a08 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.236299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.238518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b42e0-385a-41fc-85c7-70d03e6c7eff None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.254919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.255715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.256112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.256420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.264147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.265747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.274368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.275497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.275789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.276070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.276887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:49.277205 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.278652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:49.280545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:49.281338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:49.282247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:49.286441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 266/525] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:49.287052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.304992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 260/526] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:49.304992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.321001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.398223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b066599-103e-4235-aa3f-3e3e88d623f7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.406654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2b8a-e832-4758-bf91-aef79fa58063 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.434681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.435507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.435758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.436159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.437030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:49.437344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.438801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.441340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.442208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.442499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.442779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.453218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.454686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.464174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 267/527] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:49.465499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:49.473100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:49.474221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 261/528] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:49.475085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.505964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.544731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.575955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e754a2-f4a4-4702-9227-3356abc39bdd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.582842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5422-1af5-4da5-a927-8ee32473ff1d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.615229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.615892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.616181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.616489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.617334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:49.617654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.618678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.619326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.619617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.619708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.619893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.620751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:49.621067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.622492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.639506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 262/529] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:49.639506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.656165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 268/530] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:49.657449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.770674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94d495-f14e-48d2-b0d3-549d640c60e0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.788559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d29c83-c8fe-4ce4-ac8e-ef65bd4c6624 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:49.792560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.820679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:49.829116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.830121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.830580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.830965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.833596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:49.834672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:49.836045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:49.836626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:49.837574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:49.838029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.839572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.860852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 269/531] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:49.862285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:49.919270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:49.921271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:49.995210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf684e-413d-4cbe-9887-3c9f7acd6d87 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.039499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.040924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.041358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.042310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.043566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=fcd9ef87632c49399f3ec6a92ce92709) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:50.044054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.046642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.060683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 270/532] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/role_assignments?user.id=fcd9ef87632c49399f3ec6a92ce92709&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:50.060967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 263/533] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:50.061994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.066900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.107210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.110597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.220241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26cd7-4e16-4f88-97f7-131c0e1d0921 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.244425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c953-07d6-4247-8085-3631907e3ff6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.251809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.252645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.252927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.253196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.264666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.266166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.286142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:50.286329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:50.287097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:50.287929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:50.287929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:50.287929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:50.287929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:50.288143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.288143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.288143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.292075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 271/534] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:50.293333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.295295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.297069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:50.313714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:50.314568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:50.315394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 264/535] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:50.321652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.380300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.417345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58144-9548-4330-95d7-1519b6644a00 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.480060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.488290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.488963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.489243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.489518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.490240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:50.490543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.491930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.498012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a765263-7dea-41f6-9795-482c7a477ff1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.509567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 272/536] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:50.510848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.567628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.568343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.568644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.569023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.569988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:50.570315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.575186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.596587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 265/537] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:50.602835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.613088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d673e31-bd7b-4123-9809-80da3525c49d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.650332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.655007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.655969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.656452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.656925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.664691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.666416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:50.683471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:50.684558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:50.685478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:50.693162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 273/538] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:50.696622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:50.803599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8aa35-7afa-4f9b-b6d1-2270bbe3802f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.843912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.844655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.845064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.845716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.846657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=084b1b3181f34a2dacaa31f937f5d953) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:50.847078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:50.848660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfc70e-60da-4d0a-9d51-8d55e0482bfa None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:50.855429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 266/539] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/role_assignments?user.id=084b1b3181f34a2dacaa31f937f5d953&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:50.880025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536619d-e580-445e-8c10-e472f81b5a50 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.880371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536619d-e580-445e-8c10-e472f81b5a50 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.880611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536619d-e580-445e-8c10-e472f81b5a50 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.882057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 267/540] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:50.888505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.888699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.889022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:50.915703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:50.916887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:50.920279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef110-467b-4c08-a32c-ca92bed2a05d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:50.940446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:50.993995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:50.995531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:50.996508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:50.998540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.000116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:51.000901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:51.003481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:51.029900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 274/541] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:51.032240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:51.062474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 268/542] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:51.090256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:51.103035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:51.179755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d816f-419b-4fef-85f4-c62eaf506b0e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:51.227799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:51.228868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.229429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.229963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.230990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c845c75f561740779fe45670aacbd36c) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:51.231503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:51.233190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:51.239523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 275/543] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/role_assignments?user.id=c845c75f561740779fe45670aacbd36c&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:51.257828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f6740-8379-4a7a-aad7-5cc616dc9543 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:51.307161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:51.308362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.308874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.309351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.332997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:51.341167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:51.342049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:51.342818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:51.348966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 269/544] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:51.355775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:51.477918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88323e1-add1-4657-b1ce-7ea2665d0a78 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:51.500738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:51.518092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:51.519160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.519670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.520147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.521152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:51.521677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:51.523305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:51.532856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 276/545] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:51.541482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:51.546227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:51.671891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f98e1-f975-4d75-b5a7-5e3b2ed3a280 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:51.709930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:51.710725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.711008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.711291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.723468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:51.724986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1f9d1a1c-1dfd-44b9-a4c5-9ac96c6195e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:51.742763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:51.744141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:51.745004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:51.745004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:51.745004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:51.745004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:51.745004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 270/546] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:51.750092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:51.920052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802ed9-ee2f-4d08-a4eb-dfe82a4e0455 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:51.970626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:51.971295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.971574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.971849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.972593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:51.972897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:51.974268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c569-90fe-44a9-b370-67cfeb4f00eb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:51.985418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43143-9913-4bd5-99c8-a2ce053a84db None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:51.985715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43143-9913-4bd5-99c8-a2ce053a84db None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:51.986006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43143-9913-4bd5-99c8-a2ce053a84db None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:51.989322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 271/547] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:51.990577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 277/548] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:51.996148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e43143-9913-4bd5-99c8-a2ce053a84db None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.003816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.004112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.004420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.033043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:52.034243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:52.095327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.103714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.172858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e43143-9913-4bd5-99c8-a2ce053a84db None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.190733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 278/549] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:52.214899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.247085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:52.248144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.248507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.248786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.257850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:52.260452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:52.277468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:52.278894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:52.279940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 272/550] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:52.286729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.426855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1aa0c-65a7-4c4c-a138-bcbd7f196fc9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.447047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.468851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:52.469533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.469830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.470121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.470456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1819c1-b545-496e-bfbd-6e1bd512c98e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.470967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:52.471289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:52.473023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:52.492768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 273/551] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:33:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:52.500507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.521226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:52.522080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.522368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.522641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.534668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:52.543307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:52.544329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:52.545229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 279/552] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:52.552073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.606677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.673199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45da3f-b42b-456b-9b08-a001110c2b60 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.740273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:52.741034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.741422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.741715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.745454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0138-635e-4afe-b241-f8bd591827f8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.793731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.798668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:52.799878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.800383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.800831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.802440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:52.802904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:52.804532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8f30-0170-4a8d-b0ba-8b37382e1108 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:52.819387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 280/553] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:52.821186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e7c9-b4e9-4e35-a360-ded7114ba526 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.821986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e7c9-b4e9-4e35-a360-ded7114ba526 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.822466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e7c9-b4e9-4e35-a360-ded7114ba526 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.825051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 281/554] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:52.825441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:52.826604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668e7c9-b4e9-4e35-a360-ded7114ba526 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:52.827394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cded2-1cd3-47a6-942a-73840b58988a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:52.947306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:52.965479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668e7c9-b4e9-4e35-a360-ded7114ba526 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:52.970212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 274/555] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:33:52.971707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806443-c10f-49fe-8601-79449e9421db None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:52.972090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806443-c10f-49fe-8601-79449e9421db None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:52.972464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806443-c10f-49fe-8601-79449e9421db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:52.995504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b3806443-c10f-49fe-8601-79449e9421db None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:52.997177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b3806443-c10f-49fe-8601-79449e9421db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:53.006504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.008017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.009017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.009475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.023494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.026076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:53.048842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.049707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.050552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:53.050552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:53.050552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:53.050552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:53.053218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 282/556] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.054680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.089183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 275/557] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:53.091009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806443-c10f-49fe-8601-79449e9421db None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.095535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.181755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24996c-5aec-414f-bc81-d9092047c22a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.221656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.222457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.222743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.222903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806443-c10f-49fe-8601-79449e9421db None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.223096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.232645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.234959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.237019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:53.255983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.257378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 283/558] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.258240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.266536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.267214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.267527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.267788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.268550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:53.268865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.270950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa993-cf63-4e4c-997c-c460f26e7e9d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.287968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 276/559] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:53.287968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3432b-1fe5-4e72-b39f-abc87cf75a92 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.287968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3432b-1fe5-4e72-b39f-abc87cf75a92 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.287968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3432b-1fe5-4e72-b39f-abc87cf75a92 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.288654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 277/560] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:53.289045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3432b-1fe5-4e72-b39f-abc87cf75a92 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.355755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.378426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320356-1d02-4415-8d29-b3d6a26c9863 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.395321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3432b-1fe5-4e72-b39f-abc87cf75a92 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.414158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.415061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.415344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.415618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.426760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:53.429886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.431079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.431368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.431649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.432405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:53.432718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.434095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2adac-d45c-4dbe-a950-ccf29a86eca9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:53.435213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.436101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:53.436958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 284/561] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.437637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.453182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 278/562] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:53.454303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.454599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.454885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.473569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:53.474764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:53.497529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.544112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 279/563] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:53.544991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.553614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1451-83ad-4015-81fd-88008469b8d3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.590845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.591627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.591911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.592186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.600272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.601971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.610325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:53.619143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.620087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 285/564] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.626231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.666825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4da33a-72aa-4c48-9214-3b7d5277070b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.704121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.704886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.705155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.705442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.706192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:53.706499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.707913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.717228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 280/565] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:53.718157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.734332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26851-61f6-405f-b1af-56f06928b8c0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.747643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.771727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.772591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.772844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.773125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.780769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.782296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:53.797967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.798841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 286/566] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.804911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.831151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5777d-c4f4-4f7e-b5e7-c53c2d0fe1c3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.847789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:53.865694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.866424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.866708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.866987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.877618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:53.885394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:53.886323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:53.887147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 281/567] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:53.887831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.910289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b145c-318b-46de-88d9-ebc98f63324a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.946054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:53.946965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:53.947252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:53.947537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:53.948403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:53.948719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:53.950171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:53.968296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 287/568] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:53.969106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:53.986844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628ce1-deb8-45be-b3e4-f51df76a387e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:53.999809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.020502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.021585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.021876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.022154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.033058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.034512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8af7c036-71c5-41b0-8c60-5696be8c1ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:54.051671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:54.052611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:54.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:54.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:54.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:54.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 282/569] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:54.054362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47039-60bb-44b9-be30-03401256a46e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.054658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47039-60bb-44b9-be30-03401256a46e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.054934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47039-60bb-44b9-be30-03401256a46e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.056864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 283/570] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:54.057417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47039-60bb-44b9-be30-03401256a46e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.073741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad5ca-47c3-4a7d-8e8f-6a2bf125fed6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.086300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.109276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.109926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.110208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.110479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.111252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.111560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.113015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.125441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 288/571] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.126150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.161405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47039-60bb-44b9-be30-03401256a46e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.194712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.195374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.195669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.195952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.197277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.197594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.198969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.207308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 284/572] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.208087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.217656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.229055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecc72-7c80-4e91-9c72-857755c7371e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.262799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.263592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.263877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.264160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.274683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.276132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7f756947-bb64-413a-b8aa-a0daa5308591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:54.293864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:54.294777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:54.295633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:54.295633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:54.295633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.295633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:54.295633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 289/573] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:54.296246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.296489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.296767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.302088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.313028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c0c6-336b-4e33-b2a3-c16afe39ed4a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.313188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:54.314269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:54.346231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.346892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.347182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.347463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.348223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.348529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.349917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.362039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 285/574] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.362820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.385643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 290/575] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:54.386415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.461235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571385-4f76-4cee-abb9-5d50549e4848 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.469056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.495438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.496088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.496401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.496682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.497505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=d544be4d204445aa832e21033ba1a84e) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.497819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.499252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.499841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf340-660d-4841-812c-e004e73828a3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.504593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 286/576] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/role_assignments?user.id=d544be4d204445aa832e21033ba1a84e&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.505367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.523174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.545573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.546380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.546668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.546947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.558690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.560231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:54.579840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:54.580844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:54.581699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:54.581699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:54.581699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:54.581699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:54.584354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 291/577] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:54.585873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.629270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393212b5-5c21-47a5-9a29-4df0d0756549 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.676669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.677333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.677619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.677896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.678620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.678927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.681039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.698795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 287/578] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.698795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.709996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385c6c-95da-4642-b7c5-f3304a217a66 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.735589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.747788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.748634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.748920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.749204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.756686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.758141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:54.772810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:54.773755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:54.775228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 292/579] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:54.775816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.784893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:54.812516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641323-aeee-43c3-86a5-a282d034a41e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.859122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.859914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.860216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.860503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.871649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:54.879394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:54.880494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 288/580] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:54.886310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.896978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54700-176a-4e52-af99-860c79015b1b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:54.937955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:54.938833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:54.939190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:54.939542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:54.940364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:54.940743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:54.942313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:54.961550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 293/581] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:54.961550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:54.997114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f26d5-5c02-43c9-8e04-cc6f4a202499 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.007098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.033153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.034051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.034339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.034720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.036836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.043229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.045252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:55.060591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:55.061678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:55.062710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 289/582] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:55.063544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.070794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d64b6-d74e-473a-bff7-5ebcb46bccda None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.110791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.111471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.111759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.112044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.112916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.113288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.114729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.132389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 294/583] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:33:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:55.133221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.176585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89a510-9a59-490a-9133-79da088e5cc1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.214254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.215042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.215334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.215642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.216502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.216808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.218223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.231972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 290/584] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:55.231972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.239169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f7238-ce91-4f35-b578-a421eca4deff None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.240755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.277656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.279111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.279412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.279697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.287410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.288513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.292572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:55.307474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:55.308418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 295/585] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:55.314491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.339377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b1df-3bb8-4a23-b49c-90534ef5cd3c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.374732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.375389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.375679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.375962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.376788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.377107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.378672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.390643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 291/586] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:55.391442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.421690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c1b2-ac59-40b2-b284-d13c66aeaebb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.457556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.458370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.458654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.458922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.471255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.472828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:55.491793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:55.493428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 296/587] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:55.494339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.506873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b1a2-5279-4785-9d1d-14ab32b21035 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.510374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.526885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.546802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.547607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.547893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.548177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.562130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.563594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:55.583320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:55.584529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:55.585573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:55.585573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:55.585573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:55.585573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:55.585573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 292/588] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:55.586163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.610277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3439e-d79b-4ffd-a57f-4efa74216268 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.648541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.649744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.650035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.650311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.651159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.651470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.652960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.679235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 297/589] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:55.679235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.707752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87e9f-becc-463b-b37d-3bb966563a88 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.744832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.745721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.746013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.746295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.748094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.762794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=c6dcc9d0442c49c3ab0f852b91dce5f9, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.764294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.778605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c68851-742a-420c-a60f-b386e49986e8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.790496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 293/590] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:55 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:55.790496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.817891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:55.836049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.837202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.837942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.838444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.840164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.840662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.842619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:55.865647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 298/591] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:55.865647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:55.944156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693af8-482c-4251-81b6-0f6ae4a460a5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.989325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654599eb-3777-4055-9780-2c10d8724a05 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:55.990901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:55.991574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:55.991863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:55.992145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:55.993006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:55.993317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:55.994731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.007562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 294/592] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:56.008431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.030930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.038807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.040729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.041228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.041997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.057836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.060157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:56.084757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:56.085701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:56.087095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:56.087095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:56.087095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:56.087095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:56.089884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 299/593] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:56.091145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.104361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.130649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867af12-8c00-44ea-82b7-44bc9db1398b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.168795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.169989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.170585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.171067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.178968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.181544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.197601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345dc0-86a3-4341-8a2a-9a47e84fa851 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:56.199102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:56.199971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:56.201154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:56.203667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 295/594] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:56.204798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.238918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.239948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.240177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.240497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.250628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.252583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:56.274773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:56.275803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:33:56.276765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:56.280669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 300/595] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:56.281565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.325837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f289001-d33b-400f-85b1-2ec61ff78222 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.338281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.364743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.365762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.366248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.366724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.367647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:56.368780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.370468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.380104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.383846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 296/596] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:56.388287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.404407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54329dd2-2a26-42b0-b809-619b978a175a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.449875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.451310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.452151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.452637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.453635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:56.454124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.456581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.474164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 301/597] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:56.475258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.521865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2914a60-0158-4f8a-8072-826304b3dad1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.562136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.562826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.563114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.563394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.564274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:56.564984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.566046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.584169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 297/598] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:56.585118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.597315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321cdf-d72d-4293-8d6e-3a5f848a054e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.600633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.636043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.636924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.637219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.637498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.644880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.646523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.657504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-dac89aec-ab91-45ad-a0e8-f9298c1c2222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:56.667003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:56.667881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:56.668805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 302/599] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:56.670004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec72c3-919a-4179-a401-46552bf43e04 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.670290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec72c3-919a-4179-a401-46552bf43e04 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.670567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec72c3-919a-4179-a401-46552bf43e04 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.672814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 303/600] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:56.673762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec72c3-919a-4179-a401-46552bf43e04 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.712482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20feb-904e-44b9-98f3-1fdff68067d1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.748707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.749583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.749863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.750139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/fcd9ef87632c49399f3ec6a92ce92709/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.765399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=fcd9ef87632c49399f3ec6a92ce92709, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.767014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.780072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec72c3-919a-4179-a401-46552bf43e04 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.780467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 298/601] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:56 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/fcd9ef87632c49399f3ec6a92ce92709/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:56.781358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.836366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.838926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.839463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.840432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.856320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.857906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-263073bf-0f33-45ed-bb87-5392c0577d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:56.878367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:56.879371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:56.880339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:56.880339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:56.880339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:56.880339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:56.885250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 304/602] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:56.886759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.887053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.887330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.905822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:56.906806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:56.919472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.923321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1142a-90a4-44dd-96df-bfc9d31ff57b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:56.935414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:56.970836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:56.971955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:56.972479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:56.972981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:56.974144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:56.974766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:56.976546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:56.986531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 305/603] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:56.987185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:56.990475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 299/604] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:57.001339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.123843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18beb7-50ad-4405-859e-d17b809767d2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.130158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c1432-14e1-47c2-aea0-69ed726ac8e2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.159921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.160874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.161165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.161446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/084b1b3181f34a2dacaa31f937f5d953/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.176474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.177139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=084b1b3181f34a2dacaa31f937f5d953, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.177601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.178059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.178505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.178666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.179543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:57.180035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.182966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.200052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 300/606] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:57 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/084b1b3181f34a2dacaa31f937f5d953/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:57.200390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 306/606] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:57.201350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.201937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.217827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.242301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.356364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76fd2-963a-43a2-84c0-45142823d4ce None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.358817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda99ae-4af9-4a9e-b92d-c5c23f755723 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.392849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.393640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.393934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.394225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.408464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:57.418771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:57.419144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:57.420057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:57.420927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:57.422777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.423274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.423755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.425054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 301/607] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:57.427951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.433956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.435729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:57.452878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:57.453794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:57.454774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:57.458210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 307/608] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:57.464118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.525905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.550058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.553639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc195-b5a4-4e77-8927-6518b14bc7c6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.590154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.590976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.591411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.591840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.592630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:57.592951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.594579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.608120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 302/609] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:57.609502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.612716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aba9b0-d172-4992-a81a-8c9279c0ec0f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.672592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.673195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.673462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.673745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.674544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:57.674858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.676337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.702810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 308/610] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:57.708583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.737710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6d329-faaf-4c49-a4f8-814429aecaf6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.812725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.814551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.817517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.817957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.832561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.840882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.843360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:57.875527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:57.876525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:57.877386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:57.877386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:57.877386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:57.877386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:57.878945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e644f9-36d9-467a-ba38-9b1b1ad83090 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:57.889379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 303/611] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:57.893205 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:57.933908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:57.965480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:57.966663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:57.966663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:57.967086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c845c75f561740779fe45670aacbd36c/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:57.988278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=c845c75f561740779fe45670aacbd36c, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:57.989889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f173a-b601-407e-858d-5e4867ef249f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.004897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a260-8f4c-46ef-84d8-abbd9d9e6721 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.006835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 309/612] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:57 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c845c75f561740779fe45670aacbd36c/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:33:58.010081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af29f-2034-4107-ae92-e72a6f92c712 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.010510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af29f-2034-4107-ae92-e72a6f92c712 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.010896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af29f-2034-4107-ae92-e72a6f92c712 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.012758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 310/613] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:58.018449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.018807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.019180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.042648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:58.043979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:58.054522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.055708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.056227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.056734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.057841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:58.058401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.060068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.079612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 304/614] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:58.081271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.121640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 311/615] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:33:58.140477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:58.148013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.201180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9f3d-848a-444d-9b4f-e0d2e983dca4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.239772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.240986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.241542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.242033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.251020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.252946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:58.269898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:58.270982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:33:58.271962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:58.279410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 305/616] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:58.280981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.297813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718a2e-0ada-4e4c-8998-7ecfda6f4d70 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.309557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:58.350115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.351556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.352503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.353311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.369016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:58.380015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:58.381101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:58.381973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:58.385391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 312/617] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:58.393676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.413574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240c60-62d2-4fe0-a7e4-ebd91a802314 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.425594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:58.452729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.453783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.454285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.454772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.455850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:58.456477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.458180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.481060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 306/618] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:58.483596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.591928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeaf19-baef-4298-8950-6778fce5e005 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.629903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.631139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.631645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.632206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.644568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.646369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.661336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad7b5-e5dd-41c4-9eec-ace0956cfab2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:58.667948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:58.668869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:58.669906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:58.669906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:58.669906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:58.669906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:58.672170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 307/619] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:58.680792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.726413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:58.741449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.744461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.745944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.746455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.747768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:58.750006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.751716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.767592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 313/620] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:58.773252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.830406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09a4b-7896-4a93-8746-2a964a9c0fd3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:58.845587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:58.873418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:58.875333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:58.876916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:58.877977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:58.881085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:58.881416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:58.882903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:58.913264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 308/621] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:33:58.926499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:58.958959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e89b1-9cee-4630-a644-0c82e8a28c04 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.001779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.002919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.004932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.006201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.024851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.026439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:33:59.057943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:59.058872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:59.059764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:33:59.059764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:33:59.059764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:33:59.059764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:59.069530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.072486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 314/622] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:59.077261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.094392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742750ee-8204-47a8-a1e7-e47e2a9d2f8c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.134381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.135543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.136051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.136695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.144748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.146469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:33:59.161807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:59.162719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:33:59.163610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:33:59.169678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 309/623] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:59.172024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.250764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.277348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0b2b-5116-49c8-af48-624e013ce9c3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.312719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.313399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.313688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.313972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.314432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbee587-af2b-4e31-a08d-59071e349fbd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.314702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:59.315013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.316668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.330610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 315/624] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:59.335989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.379967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.380677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.381020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.381364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.382195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:59.382514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.384156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c91b-2594-4b5a-87fa-3fe8019f4ac1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.396620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.401482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 310/625] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:59.402868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c794-a34e-4a2c-b499-7a3eca62ea27 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.403485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c794-a34e-4a2c-b499-7a3eca62ea27 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.408859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c794-a34e-4a2c-b499-7a3eca62ea27 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.408859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 311/626] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:33:59.408859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c794-a34e-4a2c-b499-7a3eca62ea27 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.465781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570059-e6df-4f1e-a436-c0f65e8b6a3a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.501576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.502715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.503226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.503669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.512050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.513811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-44c923f7-6195-4542-bf38-72a6c031c8a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:33:59.530062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:59.531022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:33:59.531946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:59.534875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 316/627] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:33:59.544241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.544402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c794-a34e-4a2c-b499-7a3eca62ea27 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.544750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.545193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.545604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.562490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:33:59.563913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:33:59.581998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.583106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.583670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.584044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/d544be4d204445aa832e21033ba1a84e/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.599783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=d544be4d204445aa832e21033ba1a84e, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.601687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.619027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 312/628] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:33:59 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/d544be4d204445aa832e21033ba1a84e/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:33:59.620310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.647657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 317/629] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:33:59.684980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.693372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.744805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674183f-9a77-46b7-be68-3e6ab8767dd7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.825469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.826667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.827114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.827542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.828595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:33:59.828910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:33:59.830364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:33:59.849578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 313/630] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:33:59.853003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328e12-9876-4e98-b1d3-f9590eeb25c5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:33:59.856469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.893532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:33:59.901946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:33:59.902855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.903215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.903572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.914765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-75cb032d-1928-4b34-8251-e796e1e98558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:33:59.923422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:33:59.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:33:59.925369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:33:59.926675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 318/631] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:33:59.927288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed70b-05da-452d-813b-1f80e829849f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:33:59.927584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed70b-05da-452d-813b-1f80e829849f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:33:59.928365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed70b-05da-452d-813b-1f80e829849f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:33:59.931451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 319/632] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:33:59.934057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed70b-05da-452d-813b-1f80e829849f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:33:59.987398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f059ca-945f-469b-9320-a3a421b1329c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.002177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.038361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.039314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.039633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.039949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.087174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed70b-05da-452d-813b-1f80e829849f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.125139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.125925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.126271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.126551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.127370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:00.127679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.128055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.129221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0984-716f-4113-9772-06e38342075c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.129548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.139795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 320/633] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:00.141232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.141528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.141809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.159955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:00.161320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:00.214289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.237059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 314/634] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:00.244233 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.244791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 321/635] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:00.245892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.249032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.378597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979141-32eb-47cf-8702-e673b37b2559 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.391035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d31f6-24fd-42dd-b69d-834c2ab641f6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.414498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.415832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.416123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.416434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.427635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.429147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.436324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.437285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.437661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.438031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.455144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.456662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:00.458822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:00.460012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:00.461136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:00.461136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:00.461136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:00.461136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:00.463005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 315/636] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:00.463956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6879ea8d-6148-4f3b-afb4-8538ea47eccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:00.482542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:00.483642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:00.484778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:00.484778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:00.484778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:00.484778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:00.490574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 322/637] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:00.490574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b203e7-97d7-4df1-8a9d-229890f408d2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.490574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b203e7-97d7-4df1-8a9d-229890f408d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.490574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b203e7-97d7-4df1-8a9d-229890f408d2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.490574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 323/638] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:00.491583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b203e7-97d7-4df1-8a9d-229890f408d2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.532154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.544496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.594176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4a39-78e6-498e-a8c0-24018517a619 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.616728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b203e7-97d7-4df1-8a9d-229890f408d2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.635533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.635533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.635533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.635533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.653812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:00.663420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:00.664636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:00.665514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:00.667233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.672545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73a57-d5e8-4ad2-b4fb-0272a50d2d08 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.673359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 316/639] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:00.674392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.688780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 324/640] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:00.688780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.688780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.688780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.715104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:00.717436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:00.794416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 325/641] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:00.795635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.816003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b5e2-3667-4cee-9afe-ed5a2a0b72fb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.828334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.840109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:00.862194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.862865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.863155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.863437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.864172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:00.864512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.865908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.878696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 317/642] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:00.879338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.916721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b62db6-daf6-4ed0-ac73-294d20787915 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:00.956156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:00.956856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:00.957146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:00.957541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:00.958298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:00.958609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:00.960136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:00.969647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 326/643] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:00.970468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:00.991982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a857e-e854-40bd-b0f8-2c47765f55f0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.028815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.029617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.029974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.030262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.037725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.039189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:01.054286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:01.055388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 318/644] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:01.056375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.068452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.086206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245633b-a2cd-4a6e-9f0f-3653abe6f557 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.101460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.123335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.124474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.125031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.125324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.138977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:01.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:01.149752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 327/645] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:01.156131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.172120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cf96-46e8-48c4-9d87-0e16baaed4ec None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.212522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.213320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.213611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.213896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.220816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.222269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:01.236624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:01.237525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:01.238426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 319/646] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:01.238931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.263229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f80f1-6bc7-4924-912f-df6f0218bcc0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.297665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.298455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.298739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.299013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.310013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.311460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.317791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:01.329635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:01.330591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:01.331473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:01.331473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:01.331473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:01.331473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:01.331473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 328/647] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:01.331743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.356979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.361119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35885c1-49f6-43c0-9350-15c22d17bc91 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.398366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.399560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.399857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.400138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.401040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:01.401471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.403036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.421405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 320/648] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:01.422329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.437307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b7f59-adfb-4bc5-b345-01fea578a142 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.472329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.473004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.473288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.473564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.474306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:01.474621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.475986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.488367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 329/649] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:01.488367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.535919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045f10-5c6d-4338-b0d3-064c8b21836d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.552473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.574128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.574941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.575347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.575897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.576722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:01.577038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.578471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.596061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 321/650] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:01.596061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.602864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb778c-deef-4f04-9135-5a9b4dfaf651 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.615895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.638714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.638714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.638943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.639213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.639937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:01.640278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.641655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.654288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 330/651] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:01.659442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.716754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d492ce3-4712-4e58-a5d4-0f3a2c72b744 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.759580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.760515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.761256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.761564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.765003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944e5c-db40-49ba-a49e-b2a721de150b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.793125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.808117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.808945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.809240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.809523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.819921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.821934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:01.840343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:01.841223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:01.842108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:01.842108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:01.842108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:01.842108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:01.842108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 331/652] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:01.842377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.843994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.845501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.863632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:01.940694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0135c-f3a9-4ad7-b9ea-2586ef2b2f04 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:01.946841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 322/653] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:01.947586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:01.977045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:01.977642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.977927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.978209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.979033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:01.979352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:01.980829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a6240-0884-40a4-883b-53d8d9bc5fb4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:01.986559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 332/654] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:01.987760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49434d-962c-4830-bbfc-2235d522b927 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:01.988051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49434d-962c-4830-bbfc-2235d522b927 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:01.988370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49434d-962c-4830-bbfc-2235d522b927 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:01.989586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 333/655] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:01.990299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49434d-962c-4830-bbfc-2235d522b927 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.034306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.066977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12cbc2-8b01-468a-bf6f-0728d247365d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.088909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.110398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.111578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.112066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.112546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.118069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49434d-962c-4830-bbfc-2235d522b927 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.122355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.124094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:02.140816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:02.141821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:02.142748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 323/656] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:02.143345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.165022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.166010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.166302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.166582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.168249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:02.168459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.169860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf34ca-13dd-4d2d-a772-ea12afc09aaa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.183920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 334/657] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:02.185229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.185520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.185797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.205391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:02.206586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:02.258522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24586-86e2-41b6-a056-00b8bafc1f4e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.283578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 335/658] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:02.284973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.298436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.299604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.300082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.300621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.313774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.315237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.321590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:02.333556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:02.334509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:02.335420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:02.335420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:02.335420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:02.335420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:02.339823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 324/659] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:02.340473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.371967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.407817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e552-9036-4ee8-8987-243ee9c7b866 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.444900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d059-e8b7-446d-9e1c-e070173e9537 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.447889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.448619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.448910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.449192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.450038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:02.450351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.452288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.476914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 336/660] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:02.477923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.479817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.480742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.481025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.481300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.489001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.490470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:02.504782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:02.505777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:02.506731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 325/661] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:02.507321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.574022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.594572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b255c-213a-4985-88c6-742f4bca3d6c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.603372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.613991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ea11-2923-41c5-ac1d-fb37d2479dc9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.631485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.632317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.632602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.632911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.643893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:02.651687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:02.652765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:02.653608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 337/662] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:02.654381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.668735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.669400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.669700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.669946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.670674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:02.670985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.672480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.686499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 326/663] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:02.687938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.763089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c543-315a-419c-a9ca-d066960c61e9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.800025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.800922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.801360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.801647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.806603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfe24-ad27-486a-aecd-33714219a39f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.817181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.842838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:02.843445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:02.843734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:02.844014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:02.844945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:02.845261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.846894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.865142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 327/664] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:02.866055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:02.877567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:02.882493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:02.883999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:02.975547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36d3c-9a30-42c6-a2b9-caa86cdd8cb2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:02.994716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 338/665] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:02.994716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.015545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.016236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.016529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.016810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.017562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:03.017873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.019248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.032065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 328/666] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:03.032065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.045240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.107133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.107384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac281-e0e2-4ef3-8d70-95eab57602fc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.144963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.145707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecbf7f-4a01-4430-beac-465b1294220a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.145819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.146044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.146327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.155645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.157510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:03.173355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:03.174481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:03.175604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:03.181434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 339/667] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:03.181434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.189992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.190640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.190928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.191210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.262030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.264462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.281059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f6ce-4b8b-4391-8b16-7b19afccfad1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.283324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.322095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.323215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.323795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.324420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.335393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.337136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.339004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:03.355556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:03.356518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:03.357502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:03.357502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:03.357502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.357502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:03.361357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 340/668] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:03.361981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.378814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 329/669] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:03.378814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.472846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1595d-310e-4f89-b9bd-abb348fafb8d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.485215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d953e5-f4db-4abb-a357-471cd869f6a7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.506847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.507647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.507927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.508739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.519445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.520928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.523770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.525255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.525771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.526272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.527290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:03.527876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.529701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:03.538261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:03.539130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:03.540723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:03.540723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:03.540723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.540723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:03.540723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 341/670] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:03.541009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.548541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 330/671] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:03.549585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.555521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.592893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.667695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bc450-ce96-46a0-a978-c249c2b3e674 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.675017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95bf01-a569-4c27-b0cf-921262eaab75 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.705752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.706741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.707293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.707580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.708395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:03.708678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.710190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.710763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.712082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.712394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.712674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.724011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.724524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 342/672] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:03.725498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.730588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:03.755362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:03.756282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:03.757166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:03.757166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:03.757166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:03.757166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:03.757786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 331/673] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:03.759269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.796548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.833447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc83c7-b767-4f9a-b1cc-a59e9ace66f9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.849912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:03.870312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e740e30-2ae0-47a2-80a6-c6a805937408 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:03.871251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.871927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.872240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.872528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.873403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:03.873608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.874935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.891529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 343/674] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:03.891529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:03.910818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:03.911479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:03.911761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:03.912059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:03.912999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=fcd9ef87632c49399f3ec6a92ce92709) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:03.913321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:03.914847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:03.920839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 332/675] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/role_assignments?user.id=fcd9ef87632c49399f3ec6a92ce92709&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:03.921618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.019097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471efa3-ebba-4012-ae3a-f3c0347609c3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.050693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.061056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.061977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.062336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.062744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.071405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.073153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.075459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ab2e-4f4c-4dd7-b9ea-5c6c59203f44 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:04.092070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:04.093249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:04.094363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:04.100125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 344/676] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:04.101145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.122724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.123484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.123780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.124064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.124834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:04.125148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.126541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.138817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 333/677] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:04.139475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.149070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.222081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d14e9-9ea2-4ac5-8588-a9d50cefbd8c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.253238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798000-f0fc-42a4-9d76-01fd38315092 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.257482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.258320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.258608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.258886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.266458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.267924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4633674d-5757-4cf3-9d78-9e7dda41ae18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:04.283335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:04.284318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:04.285244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 345/678] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:04.285822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb4f7-b382-4bb9-9987-3bcd9d971f55 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.286477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb4f7-b382-4bb9-9987-3bcd9d971f55 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.286477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb4f7-b382-4bb9-9987-3bcd9d971f55 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.287693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 346/679] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:04.292829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afb4f7-b382-4bb9-9987-3bcd9d971f55 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.293925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.294588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.294872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.295151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.295994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:04.297122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.297840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.315994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 334/680] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:04.315994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.351607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.385780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.405856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afb4f7-b382-4bb9-9987-3bcd9d971f55 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.432118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeecd4-aa62-4d94-b519-f335d390777e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.454416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.454416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.454416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.454416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.460235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.460235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-79b72040-f95b-4970-a546-f530c6734806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:04.474601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:04.475560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:04.477050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 347/681] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:04.477541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.477541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.477674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.494570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:04.495536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.495761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:04.496447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.496803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.497150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.498064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:04.498449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.499973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.523139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 335/682] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:04.523139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.571483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 348/683] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:04.572226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.615570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.646392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04ddaf-1663-48e4-97d3-d89c009f58ee None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.671348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.683571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.684255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.684550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.684828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.685656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=084b1b3181f34a2dacaa31f937f5d953) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:04.685979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.687416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.688869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597f694-5e39-4a40-9535-c252c06d711e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.700229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 336/684] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/role_assignments?user.id=084b1b3181f34a2dacaa31f937f5d953&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:04.700229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.746544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.756812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.782012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 349/685] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:04.782996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:04.822906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1063f-cd20-4026-a4eb-befbe9112ad8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.861330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.861987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.862278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.862550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.910386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.916054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb1f21-f4e8-4e54-8a6a-63d12756590b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:04.932806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:04.950231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:04.953015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:04.970134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:04.970968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:04.971255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:04.971527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:04.988533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:04.998948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:04.999942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:05.000876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 350/686] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:05.002101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.078703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 337/687] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:05.079741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.110416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e033df-f931-491a-beab-82458e9ea8a5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.146730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.147519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.147917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.148228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.149638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c845c75f561740779fe45670aacbd36c) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:05.149960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.151676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.158995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 351/688] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/role_assignments?user.id=c845c75f561740779fe45670aacbd36c&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:05.159966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.180479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.191384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.194411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519275d-5301-40b0-9b13-21c66e311c2d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.232358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.233196 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.233580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.233956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.234816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:05.235225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.236808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.246654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 338/689] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:05.257346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.290950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba2cf-9608-44fa-8a3f-aac8e5b50083 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.330220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.331050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.331342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.331741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.346965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.346965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:05.367674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:05.368894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:05.369911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:05.369911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:05.369911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:05.369911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:05.370650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 352/690] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:05.376758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.436590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358262-cbd1-480b-9a5a-434c8c2de842 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.474691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.481176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.481985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.482340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.482615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.494711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.496177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.509404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732a5d2-0b82-416d-af08-391507b4668f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:05.518657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:05.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:05.520639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:05.520639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:05.520639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:05.520639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:05.520639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 339/691] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:05.525349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.528661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.559795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.560697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.560989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.562660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.562660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:05.562855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.564894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.581739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 353/692] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:05.594326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.691176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b6c8-c43d-4a04-9af4-8417cb626b6e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.753579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.754603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.755089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.755567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.756541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:05.757051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.759181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.760132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432e2b-6558-43a8-a291-1d88ec5f5503 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.780806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 340/693] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:05.785219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.819346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.821182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.821488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.821771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.830148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.837915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.839406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:05.868218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:05.869165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:05.870016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:05.872545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 354/694] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:05.878796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:05.883192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:05.927815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d9709-8db3-4dc7-a889-ff059b2e727a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:05.969712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:05.970623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:05.970914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:05.971197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:05.982912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:05.984433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:06.002833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:06.003875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:06.005382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 341/695] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:06.010319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.109094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a336d2-5e31-443a-b1a6-5af4502d4c5b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.157830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.158609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.158892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.159180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.159987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:06.160332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.161802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.176898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 355/696] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:06.182650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.242244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4895fe-acb1-424b-9235-b0dc6d06ef67 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.243220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.292901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccc27-4c4a-4dac-8ad2-3645ecc50458 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.294998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.332202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.332893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.333184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.333471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.334320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:06.334637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.336102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.339333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.339994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.340307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.340590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.341488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=d544be4d204445aa832e21033ba1a84e) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:06.341809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.343359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363152bc-2fe4-41f3-8916-8a230a894e0a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.350272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 356/697] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/role_assignments?user.id=d544be4d204445aa832e21033ba1a84e&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:06.351651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990f30-fc36-4690-a654-81e196b6154b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.351967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990f30-fc36-4690-a654-81e196b6154b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.360138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 342/698] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:06.360442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990f30-fc36-4690-a654-81e196b6154b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.362207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 357/699] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:06.367030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.369687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.369986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.370268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.398213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:06.399994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:06.494043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 358/700] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:06.520562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14eae-3441-4f3b-9286-df4e99251b4e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.521105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.564155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.564786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.565059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.565339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.614015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.640179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.661520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.663000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.678935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517884fe-5d50-4bb1-b554-adf0f06d075d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.723087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.724919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.725694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.726161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.745050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.747350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:06.767115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:06.768060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:06.769180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:06.769180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:06.769180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:06.769180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:06.771042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 359/701] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:06.775899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 343/702] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:06.780311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.783091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:06.877146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.899804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47161a-d209-4361-b600-eb78b27b8e5e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.918320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:06.922538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b743-4ecf-4a6a-8549-36ca2d154b43 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:06.954514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.955321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.955608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.955945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.969203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:06.969375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.970266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:06.970749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:06.970856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.971301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:06.972230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:06.973027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:06.975006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:06.991082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 360/703] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:06.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:06.999212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:07.000144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:07.000144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:07.000144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:07.000144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:07.000144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 344/704] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:07.001711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.001846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.124901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f96eb-4378-4715-adaf-a8a213819426 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.166027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.166429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2fa8-c495-4581-80bc-5867179539c8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.166863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.166939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.168227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:07.168554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.170901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f53c2-7e8d-4a55-8fd5-914df4f0288b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.184613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:07.188778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 345/705] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:07.190316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494174c-a71d-4cd1-bd66-cf1193984dc6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.190668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494174c-a71d-4cd1-bd66-cf1193984dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.191013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494174c-a71d-4cd1-bd66-cf1193984dc6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.192611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 346/706] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:07.199140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494174c-a71d-4cd1-bd66-cf1193984dc6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.214981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.215890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.216326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.216725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.217778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.219421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41d60-d7ac-4561-aa34-4d938ccc72f8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.243189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 361/707] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:34:07 2022] POST /identity/v3/users => generated 254 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:07.244782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.245151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.267605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:07.269293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:07.283069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:07.326224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494174c-a71d-4cd1-bd66-cf1193984dc6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.402776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.403595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.403885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.404170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.419693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.421585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.424544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 362/708] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:07.439547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:07.440542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:07.441419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 347/709] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:07.447903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.461972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.566041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:07.601274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ce36b-0ad1-45c7-b967-d2bc8393cf75 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.606144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77a4eb-1660-4c00-871c-cd874f79459a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.642454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.643611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.644142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.644670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.645536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.647119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:07.664385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:07.665501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:07.666392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:07.669483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 348/710] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:07.681155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.689072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.690341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.690955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.691568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.694202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:07.694777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.699058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.736649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 363/711] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:07.737632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.747031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:07.815014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6aa5cc-fa5a-4076-9471-c34038d8a6a9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.835029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:07.853563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9393b6-06d1-43e4-92f8-4ddc18929486 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:07.856218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.857179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.857821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.858307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.859255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:07.859775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.861403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae650-20f6-4c83-860f-99ede734f1e7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.866724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 349/712] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:07.872858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74514-11ba-478e-9807-3d709c714f67 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.873500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74514-11ba-478e-9807-3d709c714f67 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.873996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74514-11ba-478e-9807-3d709c714f67 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.875821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 350/713] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:07.876923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74514-11ba-478e-9807-3d709c714f67 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:07.891998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:07.892572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.892860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.893144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.894771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:07.895094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:07.896694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8085c-ca33-4636-861f-02bc15f6466a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:07.903769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 364/714] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:07.913571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:07.913946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:07.914153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:07.941679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:07.943216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:08.000991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74514-11ba-478e-9807-3d709c714f67 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:08.017528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:08.023676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 365/715] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:08.050357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:08.051359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:08.051800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:08.052303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:08.053402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:08.053963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:08.056108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:08.056792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:08.063987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 351/716] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:08.174206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5422e4-9592-4302-bc3f-35219f584f3e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:08.221877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:08.223053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:08.223524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:08.224004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:08.225174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:08.227590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:08.262258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:08.264183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:08.267524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 366/717] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:08 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:08.277461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:08.361778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:08.418509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88a33-9d9c-4157-b533-6172fbc84f7a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:08.458098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:08.458775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:08.459066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:08.459347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:08.460067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] RBAC: Adding query filter params (name=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:08.460406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:08.462335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afc9e5-16fd-4e8e-999a-0f2686bd1bd8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:08.471178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 352/718] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:08.476663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:08.566181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:08.618850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e144a5e-c28e-4e41-ae3c-4ee4a358c12f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:08.679633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:08.680433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:08.680722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:08.681003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:08.681713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:08.682021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:08.683404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce24cf-dc95-409f-a890-604afa9bb4b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:08.693207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 367/719] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:09.352593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f1d47-0b4d-4e9c-9be2-ece7d4927c78 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:09.353122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f1d47-0b4d-4e9c-9be2-ece7d4927c78 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:09.353201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f1d47-0b4d-4e9c-9be2-ece7d4927c78 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:09.354794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 353/720] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:09.360124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:09.360569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:09.360739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:09.381285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:09.382553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:09.479782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 368/721] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:09.502573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f1d47-0b4d-4e9c-9be2-ece7d4927c78 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:09.673859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f1d47-0b4d-4e9c-9be2-ece7d4927c78 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:09.686370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:09.721925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:09.722735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:09.723025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:09.723305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:09.739015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:09.747219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:09.748138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:09.749149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 354/722] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:09.757671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:09.853066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:09.904468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e27e7-48c2-4a3b-9446-74dd7399d81e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:09.940911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:09.941636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:09.941929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:09.942232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:09.943019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:09.943443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:09.944894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:09.954832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 369/723] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:09.959969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.129041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfad4a-d581-49a9-9eda-08de65ef80ba None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:10.181316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:10.182046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.182335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.182617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.199737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:10.201493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:10.221836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:10.222941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:10.224110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:10.224110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:10.224110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:10.224110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:10.224110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 355/724] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:10.229428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.372965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f91189-aa80-4446-b1f2-bc8cf04210aa None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:10.403193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:10.425916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:10.426591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.426887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.427168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.427894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:10.428222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:10.429612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1c80-743c-4c05-99ce-299196cd8fcc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:10.449521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 370/725] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:10.455100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.483439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:10.557366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656136c-d0f1-4c33-b1c7-d5b1859e43b5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.558018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656136c-d0f1-4c33-b1c7-d5b1859e43b5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.558499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656136c-d0f1-4c33-b1c7-d5b1859e43b5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.560320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 371/726] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:10.565386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373d0e4-1f03-47cd-aa9c-29393878005c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.565914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373d0e4-1f03-47cd-aa9c-29393878005c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.566392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373d0e4-1f03-47cd-aa9c-29393878005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.591480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f373d0e4-1f03-47cd-aa9c-29393878005c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:10.593611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f373d0e4-1f03-47cd-aa9c-29393878005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:10.595819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b28cf3-3225-4b9c-969f-aeaf5f498b76 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:10.641734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:10.642541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.642824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.643097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.659236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:10.660738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-47a0424c-ea9a-42fe-a647-e06d6e8b319a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:10.675789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:10.676802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:10.677720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 356/727] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:10.679187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7485396-fd54-44ae-98ef-f613dcce37ef None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.679187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7485396-fd54-44ae-98ef-f613dcce37ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.679187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7485396-fd54-44ae-98ef-f613dcce37ef None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.684328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 357/728] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:10.685781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aaeea-a2ff-45c5-a3ef-409610dfd534 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.686085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aaeea-a2ff-45c5-a3ef-409610dfd534 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.686371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aaeea-a2ff-45c5-a3ef-409610dfd534 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.687756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 358/729] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:10.692223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aaeea-a2ff-45c5-a3ef-409610dfd534 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.708389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 372/730] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 13:34:10.708389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da12ccf-d40f-411d-ae87-d0b744fb5e17 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.708389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da12ccf-d40f-411d-ae87-d0b744fb5e17 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.708389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da12ccf-d40f-411d-ae87-d0b744fb5e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.735160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4da12ccf-d40f-411d-ae87-d0b744fb5e17 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:10.736879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4da12ccf-d40f-411d-ae87-d0b744fb5e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:10.779314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:10.801712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aaeea-a2ff-45c5-a3ef-409610dfd534 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:10.815357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 373/731] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:10.817088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.817406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.817709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.841726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:10.842371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:10.842958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:10.843440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:10.843690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:10.844144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:10.845103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:10.845420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:10.847124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:10.866877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 359/732] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:34:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:10.868619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.887616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:10.928692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 374/733] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:10.928692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:10.980905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb3e2-fbcf-4826-a58c-bdfbc08b0614 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.016681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.017711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.018455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.018739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.026755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.031445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:11.037736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b17c9-1287-45f4-bd76-06ce9be358ae None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:11.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:11.041227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:11.042082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 360/734] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:11.042774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.081050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.082599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.082890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.083171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.083930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.085306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.103221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 375/735] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:10 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:11.104066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.148328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.187924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb825f6-92fa-4ece-b40f-0c3046706b32 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.234961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.235543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.235868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.236154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.255559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a225-3d99-45c7-826c-076793437de9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.299125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.299952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.300260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.301050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.309255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.313429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:11.314080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.315581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560a978-5998-4f9a-acf7-ce4390c4129c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:11.321781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:11.322788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:11.323709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 376/736] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:11.324464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.421291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.428985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 361/737] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 13:34:11.431055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a964e-12c0-43c6-bef8-45b9afbc4791 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.431341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a964e-12c0-43c6-bef8-45b9afbc4791 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.431619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a964e-12c0-43c6-bef8-45b9afbc4791 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.433081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 362/738] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:11.433652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a964e-12c0-43c6-bef8-45b9afbc4791 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.440631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0446b7-d3dd-461e-a55e-cff65fb8a149 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.478640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.479417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.479787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.480137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.480990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:11.481374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.482781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df703-f729-4398-a3b3-e3f2590f165f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.491314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 377/739] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:11.493126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.493450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.493707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.510271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:11.511493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:11.544996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.552421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a964e-12c0-43c6-bef8-45b9afbc4791 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.580955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 378/740] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 13:34:11.581721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.596515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.597996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.598760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.599266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.600989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:11.601538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.603765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.613202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 363/741] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:11.613872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.685020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.706171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226841cf-d9d0-4353-85b5-074e4e3cd29e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.735636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd27b-21ce-4455-bafd-ba5a33148970 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.743233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.743964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.744278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.744560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.755369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.757502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.771049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.771843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.772130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.772454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:11.776397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:11.777296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:11.778198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:11.778198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:11.778198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.778198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:11.778198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 379/742] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:11.778481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.784477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.785974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:11.804633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:11.806133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:11.807020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:11.807020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:11.807020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.807020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:11.807020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 364/743] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:11.807289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.819198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.901326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077f8a-00f7-4b4f-8e6b-4fafddb9d135 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.916247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa199-c6f8-449c-a2b9-fd73aec48158 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:11.941384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.942097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.942408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.942659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.943484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.949493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.951098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:11.951891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:11.952177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:11.952489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:11.954473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:11.964586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:11.966045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:11.968588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 380/744] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:11 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:11.969255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:11.996826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:11.997766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:11.998643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:11.998643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:11.998643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:11.998643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:11.998643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 365/745] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:11.998926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.089325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.122356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036cb6-2aa0-472f-8bca-cabef42a606a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.152595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a9b9c-dd05-475e-870b-1c2d5250b94e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.167280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.167962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.168292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.168580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.169307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.169621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.171037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.184311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 381/746] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.185226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.193859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.195206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.195739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.196616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.197852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.198323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.200146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.218336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 366/747] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.220377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.252729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.313119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb68b-d94d-4780-8e0b-e4202ff87f72 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.333352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97af6-dd0e-4ba4-be97-f40f85a8142b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.353920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.354961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.355932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.356666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.357285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.358791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.359494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.361125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.370337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.371142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.371432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.372114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.380029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.380363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.380592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 382/748] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.381778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:12.395023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:12.395944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:12.396993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 367/749] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:12.397493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.496078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86764-7849-40bb-a89d-d8f223c5672d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.500839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76592b5-c0cf-4f74-b927-7dc4f7ecbe95 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.532139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.536569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.537647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.538199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.538421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.538930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.539219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.540039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.540349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.548220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.548931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.549695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.550818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:12.565838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:12.566783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:12.567712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:12.569889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:12.571295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:12.572239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:12.572769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 368/750] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:12.573486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.579740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 383/751] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:12.580867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.618630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.688658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89d24-c04a-4731-8b6e-172324984005 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.694809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e003fe-64fd-4b92-a2fe-c002dfc884fb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.726614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.727332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.727600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.727879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.728813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.729133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.730591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.734694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.735631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.736123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.738527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.739401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.739721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.741213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.747428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 369/752] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.748591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.763460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 384/753] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.768532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.798571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.873139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:12.876617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e7dbf-0099-4b58-94f2-bb6890a87a20 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.892353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e009ef4-05b5-4dc6-9e42-ce32d0bf42b3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:12.912831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.913642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.914036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.914491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.915449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.915888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.917488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.933057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:12.933971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:12.934448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:12.934934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:12.935946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=d544be4d204445aa832e21033ba1a84e) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:12.936495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 370/754] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.936620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:12.937432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:12.938476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:12.945179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 385/755] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/role_assignments?user.id=d544be4d204445aa832e21033ba1a84e&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:12.953579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.047093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81b5d9-4fab-45b1-b8d6-0c7c8e686198 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.063446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.075978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6faec-b10d-4b72-ac47-78a0fab34c62 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.085754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.086663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.087003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.087281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.098907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.100522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.118816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.119898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:13.120221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:13.121187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:13.122067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:13.122067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:13.122067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:13.122067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:13.122067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 371/756] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:13.123054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.123567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.127343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.140224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.208894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.210913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.237900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce864d-efbd-4121-92c1-dfbdefa01ca7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.274553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.275169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.275463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.275748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.277086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:13.277467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.278846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015453d-3d64-4fbb-9e9a-b9f6ded72bac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.293077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 372/757] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:13.294436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2d0ee-a43a-4474-be64-e6ab983f3c51 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.294731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2d0ee-a43a-4474-be64-e6ab983f3c51 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.295016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2d0ee-a43a-4474-be64-e6ab983f3c51 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.300803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 373/758] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:13.302070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.302369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.302654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.323011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:13.324294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.324407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:13.344313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 386/759] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:13.345554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.400834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.407229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 374/760] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:13.408707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.474226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69a73-7796-4345-a2db-6febf9019bb5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.516621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.517420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.517731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.518140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.525631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.527222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.530951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cac73-8a86-4e7c-8e81-2388b169b58d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:13.541252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:13.542155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:13.543078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 387/761] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:13.543807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.579048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.580757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.581272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.581743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.597326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.599900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.604743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:13.627190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:13.628488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:13.629422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:13.629422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:13.629422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:13.629422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:13.629422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 375/762] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:13.635286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.666637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabcb76-adc1-4a20-86e6-63de16833980 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.702913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.703271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.704240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.704621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.704801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.705427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.707221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:13.720428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:13.721378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:13.722202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:13.726532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 388/763] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:13.727464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.761547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8685b-66a0-402e-84d0-d67713074aa0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.800129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.801200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.801718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.802228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.803300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:13.803823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.805670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.819152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 376/764] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:13.820327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.834283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9103b-6340-4553-96bf-91c5922b2d9c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.851269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.871985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.872691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.872980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.873309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.874042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:13.874351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.875737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.893596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 389/765] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:13.893596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:13.940974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d511e8-ad1f-4097-b393-eb41d99f47ca None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.955945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:13.980520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:13.981632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:13.982129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:13.982666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:13.983594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:13.984113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:13.985828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:13.995929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 377/766] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:13.996553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61cf90-fde7-46ee-912e-273aeb4fc5d7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:13.997304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.033018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.033904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.034187 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.034463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.036501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=c6dcc9d0442c49c3ab0f852b91dce5f9, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.037957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.062282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 390/767] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:13 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:34:14.063975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.115854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:14.117978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345800af-5f9a-464d-9bfc-17315f4d6636 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.156354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.157171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.157456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.157855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.167322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.168956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:14.186148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:14.187099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:14.187978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:14.192173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 378/768] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:14.193571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.214266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1c22-378a-47cd-8b07-541ad6df56e3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.233936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:14.265688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.267212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.267963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.268479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.269413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:14.269942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.272386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.283909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 391/769] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:14.294560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.323926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15243e-1604-4caa-8385-cf004a3ac938 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.378433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.379026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.379319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.379603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.380432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:14.381291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.383109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.400394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 379/770] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:14.411763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.446645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cc12-2a04-4b19-9161-7624e065fce4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.454944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:14.486241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.487015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.487308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.487587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.488410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] RBAC: Adding query filter params (interface=public, service_id=c50c00e0c60748a78e64caf24ffa5e72, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:14.488719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.490200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0790-8bdc-4b3c-b885-f74972667812 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.498963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 392/771] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/endpoints?service_id=c50c00e0c60748a78e64caf24ffa5e72&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:14.504248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035b29-46aa-4069-8f1d-b879d36be853 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.504248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035b29-46aa-4069-8f1d-b879d36be853 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.504248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035b29-46aa-4069-8f1d-b879d36be853 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.504248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 393/772] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:14.506657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb035b29-46aa-4069-8f1d-b879d36be853 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.546747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:14.553666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b82f0-ee8e-461b-ac1e-131770e98035 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.598483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.600403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.600850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.601277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.602880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=ed9c934437f44bdfac79a7fab37a0626) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:14.603350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.605511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93a9b-0034-432d-a21f-cb1e5f6ed959 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.620328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 380/773] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/role_assignments?user.id=ed9c934437f44bdfac79a7fab37a0626&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:14.620328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.620328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.620328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.649925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb035b29-46aa-4069-8f1d-b879d36be853 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:14.660952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:14.662471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:14.732244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:14.732244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:14.732244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:14.732244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:14.732718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:14.733591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:14.749769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 394/774] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:14.792058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 381/775] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:14.815273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:14.858053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:14.955304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0442-f10b-4380-b49a-64a4c4628ae4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:15.008057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:15.008905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.009191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.009574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.010245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:15.011623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ff5a0026-b17a-4cfc-9d8f-e8b6fdd40811 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:15.026234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:15.027416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:15.028485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:15.032543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 395/776] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:14 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:15.033414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.179543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:15.193871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948e65-307f-4e70-84f0-37ff1ae97ec4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:15.242056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:15.242645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.243209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.243917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:15.244242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:15.245622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd994f6e-d3b6-4a98-adea-5a88fe921eb1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:15.255315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9aab-d755-48ac-9730-7f5059fe88c3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.255608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9aab-d755-48ac-9730-7f5059fe88c3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.255892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9aab-d755-48ac-9730-7f5059fe88c3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.256642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 382/777] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:15.257295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 396/778] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:15.263281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9aab-d755-48ac-9730-7f5059fe88c3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.263438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.263903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.264287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.292785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:15.294083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:15.432588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 383/779] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:15.461380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.488570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:15.508906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9aab-d755-48ac-9730-7f5059fe88c3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:15.550895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:15.551570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.552355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.552652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.553372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:15.553686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:15.555139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:15.561370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 397/780] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:15.571210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.628755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:15.659224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9822d6-9374-4d6d-ba7b-cd5f0c22fd63 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:15.730432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:15.731286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.731583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.731861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.752855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:15.766224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:15.767129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:15.767947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 384/781] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:15.773891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.776599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ecbe-c656-4415-a17a-3fd6bcbf448a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:15.843749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:15.844444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:15.844732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:15.845012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:15.845800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] RBAC: Adding query filter params (interface=public, service_id=1a83da85fb0c4386ae0a9a39874bcc8b, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:15.852152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:15.853593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:15.862678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 398/782] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/endpoints?service_id=1a83da85fb0c4386ae0a9a39874bcc8b&interface=public®ion_id=RegionOne => generated 194 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:15.869331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:15.912573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:15.969312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b913-2556-4470-9659-d5840dff92e4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.006072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311fd06-a3d0-4cde-abf7-16aacb965ce2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.049254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.049852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.050144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.050431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.051118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:16.052755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:16.059881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 399/783] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:16.074079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.074824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.075114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.075396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.076594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:16.076942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:16.078425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:16.092341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 385/784] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:16.095102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.186141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:16.203543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d7c5-ac51-4a9d-a9d3-e1e6b6588100 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.268352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.269153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.269485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.269818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.282358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:16.283806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:16.303424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:16.304322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:16.305671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:16.305671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:16.305671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:16.305671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:16.305671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 400/785] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:16.310642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.321999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:16.419970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4077a-04a6-4de7-9a42-72947606b5b2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.458436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.459111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.459445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.459726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.460478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:16.460837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:16.462255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1186a62-fe23-4bb4-af19-d4b01a891d78 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:16.474915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 386/786] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:16.480572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.490628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1557-82b3-4336-a4b9-ac9e504698b0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.490923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1557-82b3-4336-a4b9-ac9e504698b0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.491206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1557-82b3-4336-a4b9-ac9e504698b0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.493148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 387/787] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:16.499209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.499506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.499789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.529727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:16.530927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:16.624714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:16.628874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 388/788] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:16.668893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fb82-5899-4b1b-8c46-ba650dabc7fe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.677418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.737864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.738705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.738991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.739270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.742361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:16.752910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:16.754389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:16.788239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e88ad-2c3e-4009-b510-8e129d642360 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:16.788931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:16.790990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:16.791937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:16.794482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 401/789] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:16.801185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.826295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.827097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.827946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.828266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.844220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:16.848547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:16.849544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:16.850372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:16.851008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 389/790] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:16.857300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:16.940622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:16.953055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3b89-a8d3-40a7-950d-88fbbdc9bf85 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:16.997742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:16.998524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:16.998815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:16.999090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:16.999929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:17.000328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.001802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.005615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae2d6-8753-45f5-ae56-a2a799c33e1e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.021599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 402/791] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:17.027334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.050315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.051338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.051867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.052397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.053363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:17.053882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.056121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.080561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 390/792] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:17.081825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.090255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.142013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491cbb9-5cc5-4c4b-97cc-107d69a836c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.180899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.181873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.182216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.182503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.194117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.195601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.213057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a735-e0be-470c-aafe-6712d2e9a601 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ef97f9f9-eac8-454b-b84a-8fb4425f35bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:17.216086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:17.216968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:17.218080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:17.218080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:17.218080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:17.218080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:17.218080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 403/793] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:17.218877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a5dc-d6c4-4092-a8d5-d2da071b8d61 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.219165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a5dc-d6c4-4092-a8d5-d2da071b8d61 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.219444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a5dc-d6c4-4092-a8d5-d2da071b8d61 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.228277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 404/794] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:17.228277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a5dc-d6c4-4092-a8d5-d2da071b8d61 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.238022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.256289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.257187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.257548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.257988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.269695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.271416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-be0701b1-a0fc-4f0f-8696-3bd1c90bdfab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:17.289356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:17.290474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:17.291593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:17.291593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:17.291593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:17.291593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:17.295911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 391/795] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:17.295911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.295911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.295911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.351596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a5dc-d6c4-4092-a8d5-d2da071b8d61 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.360563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.394811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.395547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.395843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.396127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.396913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:17.397281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.403024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.422922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 405/796] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:17.423980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.429914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:17.431123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:17.504438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 392/797] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:17.505276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.541243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea8c3-ff69-40d5-9a08-eb63138f6212 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.577384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.578045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.578342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.578612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.579332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:17.579642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.581276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843aef-604e-4a83-a165-63777f05ab8e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.600678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 406/798] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:17.601470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eead6d-7f7b-45bd-b69a-b6a859e6e41e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.601799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eead6d-7f7b-45bd-b69a-b6a859e6e41e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.602083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eead6d-7f7b-45bd-b69a-b6a859e6e41e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.603362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 407/799] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:17.604065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eead6d-7f7b-45bd-b69a-b6a859e6e41e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.616056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.620576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ecce-0a6a-4d82-a3be-4430a7559a05 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.639107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.669629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.670464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.670912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.671448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.678932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.680566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:17.696136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:17.697060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:17.697932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 393/800] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:17.698507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.736337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eead6d-7f7b-45bd-b69a-b6a859e6e41e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.771668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.772476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.772765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.773044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.783453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7765674f-b4ec-4649-bfd8-2a7cf4f4a672 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:17.792030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:17.793620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:17.794634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 408/801] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:17.795516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.795516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.795516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.808019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36814ee5-69c3-40ad-b107-39b717ef3fd6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:17.815202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:17.816425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:17.843601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:17.844441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:17.844717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:17.844990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:17.852292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:17.853759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:17.868775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:17.869695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:17.870602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 394/802] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:17.871817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.890963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 409/803] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:17.893038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.897365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:17.918459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:17.995505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ba75-c5b5-4242-bc85-38de0307af69 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.004885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c8007-3a08-443d-93c5-6b58d4873c69 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.032316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.032963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.033251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.033529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.034348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.034658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.036357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.041346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.042018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.042311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.042587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.043364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.043677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.045091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.054066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 395/804] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.054066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.062653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 410/805] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.063578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.142227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.150919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.164961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c735fe-888e-4f31-b5e7-04f862276221 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.176275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c56a9a-1895-4668-83a2-bd2ccacc9e75 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.201891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.202592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.202879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.203325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.204036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.204359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.205869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.215155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.216053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.216436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.216787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.217448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.218808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.224440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 396/806] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.225041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:18.236317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:18.237259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:18.238086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 411/807] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:18.239542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.336722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770eb8-a3f5-4745-a0b0-577c50113c48 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.348701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b318-e12e-4bfc-a267-2622cf5b66db None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.374961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.376131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.376638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.377094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/d544be4d204445aa832e21033ba1a84e/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.379290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=d544be4d204445aa832e21033ba1a84e, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.380946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.384086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.384921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.385210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.385493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.391439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.408228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.408444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 397/808] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:18 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/d544be4d204445aa832e21033ba1a84e/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:34:18.408538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.408538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.410325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:18.426842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:18.427861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:18.429154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:18.429154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:18.429154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:18.429154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:18.429154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 412/809] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:18.430460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.546465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c2d3-0251-4c70-9be3-4c13604ea85d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.563377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b4b6-1502-47d3-9f4e-e5ab36960d3b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.596014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.596941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.597230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.597512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.605890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.606554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.607167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.607869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.608173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.609664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.614580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 413/810] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.615186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.670862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.674609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.676135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.681202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.726145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363b891-b1ca-4851-bff2-38a3a27fc646 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.760710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.761381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.761668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.761945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.762665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.762974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.764375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893751-9e14-48ce-8116-d51e758199b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 414/811] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e95d-029c-4258-95f0-198452ced23c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e95d-029c-4258-95f0-198452ced23c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e95d-029c-4258-95f0-198452ced23c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 415/812] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:18.781330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e95d-029c-4258-95f0-198452ced23c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.802222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 398/813] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:34:18.803218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:18.888482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e95d-029c-4258-95f0-198452ced23c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.906572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.913403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:18.917110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6899-2c12-4746-b8e6-477ba7c5d187 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:18.923949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.924651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.924939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.925217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.925924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:18.926235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.927653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf40f80-bea2-4f2f-9239-f9fb947f3254 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.938366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 416/814] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:18.938366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.938366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.938366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.953312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:18.954512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:18.966623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:18.967733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:18.968026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:18.968582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:18.977667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:18.979124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:18.995416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:18.996633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 399/815] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:18.997579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.036370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 417/816] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:19.036370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.108714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b1abc-68fc-4271-9433-19222f4abbd3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.146422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.147220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.147506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.147783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.156590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a1ae6-626d-4a94-9647-341c60ad32a0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.159844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.161340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.171027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:19.182094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:19.183164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:19.184263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:19.184263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:19.184263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:19.184263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:19.185673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 400/817] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:19.186618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.202439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.202625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.203330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.203661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.204070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.205037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.206434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.227350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 418/818] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:19.228382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.318092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767bc4-95ba-4345-97a9-d022ef6c840e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.367526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.368408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.368802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.369023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b663ce7-5840-4f12-a637-9f1c1cab2388 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.369273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.370238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:19.370657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.372298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.396628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 401/819] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:19.396628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.425023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.425862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.426155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.426455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.427137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.428697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:19.441344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:19.442540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:19.443469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 419/820] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:19.444341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.483494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.486163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.535437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4c994-ed8b-43b6-8743-bc1b68bc0d2c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.581355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10643-9b2b-45f9-8bce-33070ee3a1df None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.584388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.585097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.585387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.585666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.586442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:19.586758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.588161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.600559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 402/821] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:19.601411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.624091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.625090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.625521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.625894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.639648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.641250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:19.660564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:19.661472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:19.662367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:19.662367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:19.662367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:19.662367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:19.666645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 420/822] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:19.667622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.714481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3badf7-c2fe-4b1a-9817-34ec844096b2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.738682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.751057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.751859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.752292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.752695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.753571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] RBAC: Adding query filter params (name=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:19.753983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.755664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.761109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 403/823] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:19.761999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.767581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:19.785206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bd50-3d51-4c11-a6ac-87749f1998f1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.825541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.827044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.827418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.827783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.835543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.837228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:19.858940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:19.859874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 421/824] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:19.860801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.881536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e2db-1c09-465d-961d-b697a7909a4b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.917496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:19.918172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:19.918547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:19.918895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:19.919692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:19.920069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:19.921540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:19.934101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 404/825] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:19.935093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:19.985162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6787-24ba-4b48-ad07-70e530733f6d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:19.987532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.033607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.034808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.035700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.036134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.037074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:20.037392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.038777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.049595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec57e-ccb3-4422-a488-7d860f5a59ce None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.050152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 422/826] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:20.051089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.064549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.108847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.109582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.109874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.110161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.111003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:20.111326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.112802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.131259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 405/827] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:20.132206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.157343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102556b-f20f-4b2f-a3ae-a6b292b88e9d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.192856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.194243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.194553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.194836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.204069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.206447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:20.225434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:20.226337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:20.227284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:20.232269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 423/828] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:20.233193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.247322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8c8f-c9ad-49fc-bdd4-0bede4b8ba3a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.258714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.286460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.287221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.287513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.287855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.288912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.290269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.312829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 406/829] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:20.313619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.321224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.365697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725861d-b011-40dd-99ce-b6b9fcea7233 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.415785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.416823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.417250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.417746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.418712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:20.419179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.420851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39714c2-033f-463d-b50a-283f16230992 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.428216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 424/830] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:20 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:20.465452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944023-49cc-42e8-950f-194e52bf1bc2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.514287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.514983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.515277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.515559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.516413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:20.516734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.518232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.543230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378a14-e22d-457b-bd57-e83af9f7b347 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.543429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 407/831] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:20.543543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378a14-e22d-457b-bd57-e83af9f7b347 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.543797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378a14-e22d-457b-bd57-e83af9f7b347 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.545537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 425/832] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:20.549922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.551132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.551432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.551721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.582758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:20.584349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:20.611369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.702874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 426/833] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:20.721485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66839-8615-467a-812b-8cb9f6397aac None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.730110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:20.765997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.767366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.768540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.769039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/ed9c934437f44bdfac79a7fab37a0626/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.786637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=ed9c934437f44bdfac79a7fab37a0626, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:20.788423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:20.800812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:20.804698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 408/834] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:20 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/ed9c934437f44bdfac79a7fab37a0626/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:34:20.860245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73c82-3450-4813-adbf-7ba4aed1baef None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:20.900731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:20.901656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:20.901952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:20.902239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:20.915156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:20.923559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:20.924794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:20.925866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 427/835] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:20.933452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.028878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:21.056479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45532a9-088e-488f-be7b-b2bd1e2f777a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.092393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.093070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.093358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.093637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.094393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:21.094701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.096098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.105712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 409/836] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:21.111288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.226503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf2db-819c-4492-a85a-2b683e08a477 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.244915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:21.263800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.264661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.264976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.265275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.276870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.278344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:21.296758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:21.297672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:21.298549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:21.298549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:21.298549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:21.298549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:21.298549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 428/837] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:21.305386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.413433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852ec4-b75c-4a4d-9fda-8d275065d8b5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.451279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.451948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.452263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.452546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.453273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:21.453583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.455043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144cdf8-5504-45fe-aff7-00ea47bf7487 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.457483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:21.468309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 410/838] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:21.474148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.517838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb429c1-2d70-4732-818f-b7b870180c2f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.518179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb429c1-2d70-4732-818f-b7b870180c2f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.518405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb429c1-2d70-4732-818f-b7b870180c2f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.520055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 411/839] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:21.525495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.525783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.526062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.544116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:21.545436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:21.583623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7114f3-b5e4-49a8-9712-35a0ce8f3d1e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.621692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.622496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.622788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.623070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.624837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 412/840] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:21.634585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.637993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.641233 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:21.655158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:21.656138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:21.657087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 429/841] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:21.665792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.698589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:21.755222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633131ee-3149-451b-8e3e-2d2092d91b11 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.790395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cc943-326a-4ce9-a505-11d8d8424b92 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.791048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:21.802376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.803615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.804305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.804705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.805635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.807791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:21.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:21.824916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:21.826014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:21.826753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 413/842] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:21.832148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.832463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:21.833258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:21.833557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:21.833881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:21.834684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:21.834995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:21.837231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:21.858893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 430/843] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:21.864496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:21.966603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab54cc-b66b-4534-a0e0-4c051fcb4d1a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:21.972102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db034d-2373-4dec-8952-c4a3689eddf4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.001673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.002714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.003242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.003760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.011753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.012577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.012887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.013171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.013979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:22.014294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.015779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.027000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 414/844] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:22.027906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.032671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.085325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.087375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.094939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.149171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d3d2-78d2-4e0a-b4e0-7955d89c1067 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.186789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.187510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.187802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.188082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.188822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:22.189134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.190607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.194665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.197291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 415/845] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:22.213785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 431/846] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:34:22.221088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.336852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6684ef-e06e-4028-901a-51426570dbd2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.358876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.374340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.375128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.375410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.375685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.388099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.389595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:22.408391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:22.409326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:22.410204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:22.410204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:22.410204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:22.410204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:22.410204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 416/847] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:22.415413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.526854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b467e-7b50-4e23-b308-00517fca3c3f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.562989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.563660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.563947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.564255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.564980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:22.565292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.566661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.579634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 432/848] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:22.585287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.704033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caef01e-f3a3-47ea-b333-029dcd956aee None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.740702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.741510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.741800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.742109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.749316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.750793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-2c9c9c65-eb5f-4659-af92-ed7e764bb421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:22.765992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:22.767322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:22.768234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 417/849] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:22.775698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.836788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.853399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56cc29-c3f3-47c7-9dce-73b98a2c38e1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.853830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56cc29-c3f3-47c7-9dce-73b98a2c38e1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.853988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56cc29-c3f3-47c7-9dce-73b98a2c38e1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.855812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 418/850] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:22.860983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.861348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.861700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.879770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:22.881113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:22.898596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc513635-2e6b-4a89-8622-19ab046944ad None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:22.913396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:22.945740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:22.946790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.947378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.947862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.948903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:22.949425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:22.951334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8304e-059a-4ee7-98f8-1032976fe481 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:22.970171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 433/851] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:22.970853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 419/852] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:22.971955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:22.972494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5b66-b16b-4f9e-8e22-7802fc31d25d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.972797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5b66-b16b-4f9e-8e22-7802fc31d25d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.973094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5b66-b16b-4f9e-8e22-7802fc31d25d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.974626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 434/853] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:22.979952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:22.980266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:22.980555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:22.999378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:23.000586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:23.071981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 435/854] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:23.072694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.092080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49d6ff-2f29-4e32-ace6-372ba68de671 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.113411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.129725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.130592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.130878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.131157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.131990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=d544be4d204445aa832e21033ba1a84e) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:23.132351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.133936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.139915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 420/855] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:22 2022] GET /identity/v3/role_assignments?user.id=d544be4d204445aa832e21033ba1a84e&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:23.140558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.171621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.201268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a49c-53db-4923-887c-81a4be47b011 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.243497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.244838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.245326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.245824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.246715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.248447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.258224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25696e-3c09-4742-a6cc-a3dc1af16d92 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:23.262783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:23.263762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:23.264615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:23.267695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 436/856] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:23.275716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.308945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.309746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.310031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.310332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.326250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:23.334419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:23.335400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:23.336953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 421/857] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:23.342470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.417054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e4fc-9b04-48df-b756-91007e82b44e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.418794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.457380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.467152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.468730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.469307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.469771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.471322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:23.471844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.473962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.477382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb535d6-d191-423f-a8fa-c4a954ea2047 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.486407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 437/858] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:23.487569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.532665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.533519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.533942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.534221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.534977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:23.535287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.536722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.546914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 422/859] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:23.552025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.627324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a606-aa45-4093-a160-bbccd43ba776 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.675556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.676401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.676693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.677340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.678313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:23.678624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.680241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.686100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 438/860] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:23.703912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8400338-168a-4c5e-82f2-2374555ac8d3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.744659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.745403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.745694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.745979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.759491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.761019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.768613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:23.781731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:23.782668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:23.783549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:23.783549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:23.783549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:23.783549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:23.783549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 423/861] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:23.789840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:23.832022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:23.909939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f796c-c51a-46aa-8c4b-c885d0bacbfd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:23.945476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:23.946148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:23.946438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:23.946720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:23.947447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:23.947757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:23.949164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:23.963480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 439/862] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:23.969015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:24.073928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda31f-19bf-4089-af46-eb1a51ec0602 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:24.109455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:24.110270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.110607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.110889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.119287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:24.120785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0f8a5090-cbce-48cc-ac4e-424f6b796fd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:24.135958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:24.136918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:24.137841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 424/863] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:24.143103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:24.242203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:24.251203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ccff0-1d4b-4a32-a70c-9fa240f71ff5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:24.289227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:24.289909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.290203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.290486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.291325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:24.291638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:24.293177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:24.346730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc8b-5c24-4578-be94-a25a24421125 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.347052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc8b-5c24-4578-be94-a25a24421125 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.347278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc8b-5c24-4578-be94-a25a24421125 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.349098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 425/864] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:24.355447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.355756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.356016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.374755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:24.376066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:24.432473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 440/865] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:24.437740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:24.443320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:24.463340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 426/866] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:24.485753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:24.549606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005176-e328-4dac-98d4-130a86b3eab1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:24.586385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:24.587178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951c99-f16e-4e8a-9230-bd89a22b1469 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:24.587325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.587754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.588139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.608675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:24.623113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:24.623786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.624086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.624408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.625138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:24.626528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:24.653010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 427/867] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:24 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:34:24.667441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:24.669110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:24.785331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 441/868] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:24.790979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:24.850569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:24.923165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925498f-687d-49dd-a47a-890522849b47 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:24.959421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:24.960250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:24.960545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:24.961375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:24.972763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:24.974251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:24.992411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:24.993334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:24.994216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:24.994216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:24.994216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:24.994216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:24.994216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 428/869] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:24.999721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.071026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.105503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754b3c-82d5-41cd-9f99-76451d5c820d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.140203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.140873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.141160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.141437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.142150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:25.142454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.143811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e326c-01ec-49b9-9a20-237c088bcea0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.156101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 442/870] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:25.161394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.269789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716776e-f26a-47cc-ae08-7f43e7e97e60 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.270286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716776e-f26a-47cc-ae08-7f43e7e97e60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.270286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716776e-f26a-47cc-ae08-7f43e7e97e60 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.271850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 443/871] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:25.273983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.279193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.279476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.279750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.280805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaab21-70fe-4eb2-87ab-61f3cb0316f5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.295942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:25.297153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:25.326775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.328343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.328838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.329911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.339089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.342961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:25.362517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:25.363422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:25.364318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:25.365634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 429/872] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:25.370851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 444/873] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:25.373087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.390203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.431955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.485647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ca7b4-d16d-4cc8-9c97-743d3f791d83 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.498101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84ffd-c670-445d-bf94-420d80c2e65b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.524711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.525745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.526230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.526712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.527691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:25.528290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.530356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.536768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.537589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.537878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.538156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.538830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.540421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.550616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 430/874] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:25.551697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:25.553440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:25.554382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:25.555756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 445/875] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:25.561160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.575551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.663510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4a41-40de-4fbb-b955-832edb7caac0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.678433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d61-66ff-44cc-971f-6cfe21214c4b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.680628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.699614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.700892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.701375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.701848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.702942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=ed9c934437f44bdfac79a7fab37a0626) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:25.703469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.705308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.720327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 431/876] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/role_assignments?user.id=ed9c934437f44bdfac79a7fab37a0626&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:25.723565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.724376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.724676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.724959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.725690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:25.726002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.727563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec882eb-0953-4173-8960-c2824dfaf94f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.733801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 446/877] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:25.739674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:25.831612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:25.836375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec70-6610-49fa-a098-16b8de9a8036 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.836670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec70-6610-49fa-a098-16b8de9a8036 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.836953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec70-6610-49fa-a098-16b8de9a8036 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.838610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 447/878] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:25.848385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3881-8eb7-4cc7-bb22-f8a2bacf1a6a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.848773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3881-8eb7-4cc7-bb22-f8a2bacf1a6a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.849062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3881-8eb7-4cc7-bb22-f8a2bacf1a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.857443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba296a4a-1729-47f7-8eb7-ac245b4770b8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:25.868119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-924e3881-8eb7-4cc7-bb22-f8a2bacf1a6a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:25.869382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-924e3881-8eb7-4cc7-bb22-f8a2bacf1a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:25.900455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:25.901159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:25.901445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:25.901717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:25.902438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:25.902749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:25.904162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:25.916369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 432/879] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:25.953185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 448/880] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:25.976606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:26.100732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83fa9f-c628-4bb3-a136-41a91f01d53e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:26.140438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:26.141156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:26.141435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:26.141753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:26.142482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:26.143848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259ab8-1e07-4426-801c-c4a816b16842 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:26.160095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 433/881] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:25 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:26.844983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5c66-223d-483a-8811-bc246ca0a237 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:26.845495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5c66-223d-483a-8811-bc246ca0a237 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:26.845595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5c66-223d-483a-8811-bc246ca0a237 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:26.847101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 449/882] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:26.852990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:26.853398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:26.853544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:26.859684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:26.873167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:26.874365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:26.949183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 434/883] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:26.971496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af5c66-223d-483a-8811-bc246ca0a237 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:27.068616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:27.076416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af5c66-223d-483a-8811-bc246ca0a237 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:27.112535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:27.113624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:27.114092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:27.114581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:27.115479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:27.117134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:27.130026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:27.131362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:27.132435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:27.134991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 450/884] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:27.140684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:27.246783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08d91-91e7-4aed-a551-073183caa3e6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:27.276507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:27.282756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:27.283417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:27.283702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:27.283980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:27.284725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:27.285197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:27.286797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:27.291945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 435/885] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:27.297211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:27.404817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e02ad-6296-4a9e-92e5-fd001693631b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:27.440222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:27.440898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:27.441183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:27.441455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:27.442151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:27.442457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:27.443814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:27.449496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 451/886] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:27.455718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:27.563303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99a14a-51c6-416d-94c0-493f9a664043 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:27.600909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:27.601608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:27.601894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:27.602173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:27.602965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] RBAC: Adding query filter params (interface=public, service_id=eaec89db3e0c4d3c9e15684a4fc17005, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:27.603277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:27.604705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff935-fb8e-4b4e-8ef3-f172b4137e90 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:27.612607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 436/887] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:27 2022] GET /identity/v3/endpoints?service_id=eaec89db3e0c4d3c9e15684a4fc17005&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:27.618234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:27.654790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:27.736795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce6e9-d996-4fe3-9ec5-ae00a318744b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:27.773927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:27.774959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:27.775583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:27.776062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:27.776961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:27.778529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f149e-440b-4689-8fb5-018ebefc1a9e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:27.785038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 452/888] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:27 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:34:28.033600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870afa-f4c8-48da-a2f1-a5c75032a708 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.034147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870afa-f4c8-48da-a2f1-a5c75032a708 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.034147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870afa-f4c8-48da-a2f1-a5c75032a708 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.035788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 437/889] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:28.041557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.041974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.042184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.059649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:28.060883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:28.081168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7620c7-126a-4f2a-9e2a-16f6c063d9ef None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.081457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7620c7-126a-4f2a-9e2a-16f6c063d9ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.081740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7620c7-126a-4f2a-9e2a-16f6c063d9ef None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.083365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 438/890] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:28.088731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.089017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.089302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.109011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:28.110656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:28.143310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 453/891] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:28.167320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.176326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.191175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 439/892] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:28.196919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.217288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.286421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac70bf-472d-4888-a6c7-96095dc856d5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.325892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.327235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.327974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.328732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.337037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dc83a-e7bc-457e-9e5f-b557d1b5ea41 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.344511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4164ded7-003a-4728-abd3-455a93c6ee39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:28.353218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:28.354332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:28.355365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 454/893] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:28.356307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e481c2-40cb-48ba-a3ab-fb56c66fdec4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.356307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e481c2-40cb-48ba-a3ab-fb56c66fdec4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.356592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e481c2-40cb-48ba-a3ab-fb56c66fdec4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.360377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 455/894] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:28.360377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e481c2-40cb-48ba-a3ab-fb56c66fdec4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.380531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.381205 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.381501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.381787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.382557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.383941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8586-a0e1-4a1a-be22-21c2848866bd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.397647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 440/895] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:28 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:28.399375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.399672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.399952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.428334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:28.430199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:28.465345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.496244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.500119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e481c2-40cb-48ba-a3ab-fb56c66fdec4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.530474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 441/896] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:28.542359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.542971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.543256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.543532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.544321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:28.544636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.546039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.560977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.561340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 456/897] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:28.567129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.693787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04dbd-ad0e-4185-bfba-14ac32950f3f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.709579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550001-c265-49be-8c81-d3d8fa961780 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.730562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.731354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.731634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.731908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.735192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.744283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.745760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.759652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.760777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.761268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.761770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.762622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.764215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:28.764880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:28.765729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:28.766590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:28.766590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:28.766590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:28.766590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:28.766590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 457/898] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:28.772528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:28.786660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:28.787629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:28.789563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:28.795818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 442/899] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:28.796790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.843941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:28.902541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140523c-95f2-46e3-b00a-91586cf56513 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.911716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450675f-1681-4df8-9dd5-c46ff37e5619 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:28.951155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.952961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.953739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.954376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.955436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:28.956081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.957503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:28.957884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.958354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:28.958737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:28.959111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:28.959911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:28.960514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:28.962469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:28.972226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 443/900] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:28.974296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:28.979515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 458/901] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:28.986482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.062423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.089516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d05e1-60a8-4afb-97d6-dd756bb31c08 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.098359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.128386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.129048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.129330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.129602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.130302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:29.130606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.131993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.141200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf17c-09bb-4c3e-844c-551d42a60b18 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.142169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 444/902] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:29.143410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.188311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.189584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.189874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.190201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.201042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.203072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:29.222390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:29.223707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:29.224853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:29.228332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 459/903] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:29.230638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.271717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fdcd5-f70b-46ce-9724-0d687582dc61 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.310015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.311143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.311644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.312136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.313378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] RBAC: Adding query filter params (interface=public, service_id=4e2d8ad8c1a444beac85ec93f85b2da1, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:29.313901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.315600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.326751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 445/904] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/endpoints?service_id=4e2d8ad8c1a444beac85ec93f85b2da1&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:29.328461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.337390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5deba8-f543-4fe7-a86c-8ac7f70aba85 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.346584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.368592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.373628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.374315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.374602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.374883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.375723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:29.376034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.377520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.400523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 460/905] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:29.402129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.444714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b89fb-0c8f-4198-b62d-cee868c2508c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.483056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.484085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.484711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.485186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.486120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.487938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.500375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 446/906] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:34:29.507035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00ec4-e841-4ec9-8480-d8ba0fc4f83a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.548743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.549415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.549704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.549985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.590973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.631369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.634212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de775-9a02-49d8-8e63-d103921c2779 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.740648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 461/907] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:29.746408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:29.846240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:29.850863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5cd2-a3ac-4954-97ef-b2962cf5ef29 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:29.887225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:29.888075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.888395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.888726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.898443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9349-05e1-4b45-96a6-6e8795a3cd2c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.898791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9349-05e1-4b45-96a6-6e8795a3cd2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.899079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f9349-05e1-4b45-96a6-6e8795a3cd2c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.900710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 462/908] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:29.903430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:29.906167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:29.906458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:29.906734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:29.911616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:29.923879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:29.925475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:29.931019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:29.931923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:29.932836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:29.932836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:29.932836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:29.932836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:29.932836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 447/909] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:29.942142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.005650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.015004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 463/910] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:30.039172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.070725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc52de-1819-4bed-8540-f1ec07db47a3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.108902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.110347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.110838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.111330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.112291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:30.112830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.114418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.132459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 448/911] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:30.133776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.146275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.156594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a35fd-6957-46d1-bf29-2afdb9a2eeac None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.194048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.195258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.195814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.196409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.197288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.198974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:30.212283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:30.213398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 13:34:30.214236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:30.217297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 464/912] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:30.222672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.253213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b54b-cefa-47f0-9f4b-e66c176da3a6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.298387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.300083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.301144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.301449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.301855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.309547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.311226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:30.326457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:30.327540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:30.328501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:30.332757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 449/913] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:30.333732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.362027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d409c9-ad05-4c20-b956-d49beb932a4a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.407952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.409892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.411565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.411863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.412148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.412896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:30.413213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.415133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.424276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 465/914] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:30.426652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.461176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12d0b-ba42-4f46-a790-9e8de05e02ea None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.508792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.509464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.509752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.510090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.510886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:30.511242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.512750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.531188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 450/915] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:30.532072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.544393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0ce4d-34a3-4b74-b02e-644d1fd6ea8a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.568141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.580341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.581286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.581286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.581557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.582258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:30.582567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.583946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287630f6-4c74-4f63-8111-4718286772f8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.589686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 466/916] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:30.590809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba429-943d-43bd-a237-63ecccf701b5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.591103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba429-943d-43bd-a237-63ecccf701b5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.591381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba429-943d-43bd-a237-63ecccf701b5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.596695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 467/917] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:30.596695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba429-943d-43bd-a237-63ecccf701b5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.658141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c940-6a12-46a1-b201-8c629f742b09 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.693759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.700860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.701613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.701905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.702195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.703035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] RBAC: Adding query filter params (role.id=87eab2b33d814fcc81dc388532256356, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=ed9c934437f44bdfac79a7fab37a0626) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:30.703360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.704899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095af23-947f-42aa-b224-7e9111e9f8a9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.708388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba429-943d-43bd-a237-63ecccf701b5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:30.711097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 451/918] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/role_assignments?user.id=ed9c934437f44bdfac79a7fab37a0626&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=87eab2b33d814fcc81dc388532256356 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:30.712350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.712648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.712933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.732088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:30.733496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:30.772537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:30.774173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:30.774680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:30.775488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:30.776951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:30.779481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:30.802667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 468/919] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:34:30.823450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 452/920] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:30.849467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:30.905428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:30.971623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0986f1-6063-40c4-b1bf-45575816cd36 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:31.009338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:31.010152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.010444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.010727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.011380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:31.012803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:31.025886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:31.027367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:31.028185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 469/921] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:31.034064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:31.147025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c8d8-b796-4b49-8fb4-29e2b6602d65 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:31.169819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:31.184370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:31.185042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.185328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.185608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.186323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:31.186637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:31.188017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:31.193458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 453/922] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:31.199652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:31.315736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1a7c-f4a1-4dd5-9d56-881ac967a9bf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:31.328752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:31.357493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:31.358567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.359089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.359581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.360549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:31.361067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:31.362673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:31.369428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 470/923] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:31.375462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:31.481429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dff19-0a3c-46e4-8e2e-7debdd3e9592 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:31.517569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:31.518566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.519084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.519564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.520665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] RBAC: Adding query filter params (interface=public, service_id=a6a18b0073434ad199e442f712393b01, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:31.521204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:31.522807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b41a-af57-442b-ae29-c881f1d32da3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:31.528933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 454/924] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:31 2022] GET /identity/v3/endpoints?service_id=a6a18b0073434ad199e442f712393b01&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:31.534700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:31.644288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ecfe-08c9-4dd8-87c5-e13127254b83 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:31.680087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:31.680777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.681148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.681469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.682001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:31.683358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce75a8-d8af-49a8-b6d4-1de956a7e404 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:31.689803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 471/925] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:31 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:34:31.720789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d8a-0723-49f3-af34-928a561be143 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.721432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d8a-0723-49f3-af34-928a561be143 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.721941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d8a-0723-49f3-af34-928a561be143 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.723965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 455/926] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:31.730491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:31.731094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:31.731640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:31.750680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:31.752356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:31.785162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:31.829775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 472/927] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:31.852632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f6d8a-0723-49f3-af34-928a561be143 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:31.911357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:31.970790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f6d8a-0723-49f3-af34-928a561be143 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:32.009940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:32.010671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.010956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.011228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.011882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:32.013284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:32.026308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:32.027282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:32.028297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 456/928] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 20 13:34:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:32.036437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:32.140307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dfd6c-820b-454b-8964-f5d7c7700c72 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:32.175526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:32.176583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.177199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.177697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.178606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:32.179127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:32.181334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:32.186812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 473/929] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:32.192720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:32.297480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43caa3-f29e-40f9-b0d6-9f2724f97fe6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:32.311706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:32.333854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:32.334513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.334797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.335070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.336334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:32.336642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:32.338005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a519a-1d46-4228-8f32-9471d7533683 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:32.343197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 457/930] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:32.352568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:32.429365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:32.478333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a09b-d34f-45bc-b3d6-bb85a68e4711 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:32.513111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:32.513825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.514107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.514384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.515169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:32.516570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a2bf0-5c9a-4cd3-a121-ae6a41c5b77e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:32.537904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 474/931] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:32.966771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a841b6b-f1e0-449d-9552-eefe0734322e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.967307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a841b6b-f1e0-449d-9552-eefe0734322e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.967698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a841b6b-f1e0-449d-9552-eefe0734322e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.969451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 458/932] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:32.974733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.975028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.975307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.990270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c009-e349-4c73-b9be-079ba7a1f4f7 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:32.990595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c009-e349-4c73-b9be-079ba7a1f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:32.990829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c009-e349-4c73-b9be-079ba7a1f4f7 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:32.993152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 459/933] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:32.996458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:32.997860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:33.001364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.001650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.001932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.018966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:33.020140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:33.088214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 475/934] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:33.098216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 460/935] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:33.108485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.123620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.127930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.223112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ccf43-2f88-46e8-b1e8-653e0bf1fa93 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.242635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54dd6-76e4-49f3-90ba-dac39c1bf6ec None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.251390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.266285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.267569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.268096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.268612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.281296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:33.282425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.283265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.283717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.284134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.285026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.286596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.288115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING keystone.server.flask.common [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:33.290563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:33.291649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:33.292507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:33.293280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 476/936] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:33.299073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.313700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.sql.core [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 13:34:33.313700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 13:34:33.313700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [parameters: {'id': 'e313b2587f30413ba1d0e102fa6d309e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 13:34:33.313700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86829) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e313b2587f30413ba1d0e102fa6d309e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e313b2587f30413ba1d0e102fa6d309e. Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:34:33.334674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application result.read() Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 13:34:33.336091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application yield resource Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise self.value Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application session.commit() Jul 20 13:34:33.337088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self.session.flush() Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application compat.raise_( Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 13:34:33.337963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 13:34:33.339470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application result.read() Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:34:33.340280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [parameters: {'id': 'e313b2587f30413ba1d0e102fa6d309e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.342547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:33.344398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e313b2587f30413ba1d0e102fa6d309e. Jul 20 13:34:33.346528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.349771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 461/937] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 20 13:34:33 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:33.360239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.383623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.415371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a855f-3b60-46fc-b67a-6755b6d124a6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.450415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.451346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.451635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.451914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.452711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:33.453020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.454401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.467584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 477/938] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:33.468518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.478166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7035b-68d9-405d-891d-a5aa26eb4a47 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.515203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.516228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.516683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.517057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.525180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.527198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:33.542736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:33.543836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:33.544789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:33.546288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 462/939] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:33.553764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.572717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fc79-680e-4923-9c0e-0c3874f82a0f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.592170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.627775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.627775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.627775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.627775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.628266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.640784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.642711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:33.670141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:33.671139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:33.672010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:33.672010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:33.672010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:33.672010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:33.672010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 478/940] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:33.677072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.692218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff317c-6db8-4436-90e8-28e56d9e5717 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.729782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.730610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.730901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.731177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.732436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:33.732754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.734500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.762838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 463/941] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:33.800519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a9d61-081a-4d2a-953c-0f5755421a56 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:33.841441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:33.842393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:33.842884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:33.843309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:33.844291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:33.844750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:33.846356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:33.861039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 479/942] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:33.866502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:33.968775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:33.978149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd50e-cb45-440b-864c-89b144c27377 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.017590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.018392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.018682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.018963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.026708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.028165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-07f8b963-f783-4757-b76a-227101dbd584 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:34.044042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:34.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:34.045949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 464/943] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:34.051456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.096276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2e0-3cd0-4fb5-9e79-cef35dc28470 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.096276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2e0-3cd0-4fb5-9e79-cef35dc28470 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.096577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2e0-3cd0-4fb5-9e79-cef35dc28470 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.098184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 465/944] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:34.102458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.103685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.104043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.104882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.122274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:34.123796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:34.164659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d89e-b617-473c-8b2c-d20f34c33270 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.202023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.202546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.202837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.203121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.203956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:34.204311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.206401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.216010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 466/945] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:34.236440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 480/946] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:34.242615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.244908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.332947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.367174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d4f7-e3bc-4690-9a0f-fc90b002fe8d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.369551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.371605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52bcd8-3358-4df9-a20a-c7f0ff3e98d0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.404774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.405584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.405874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.406154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.406806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.408182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.416562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.417646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.418137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.418670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:34.420525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:34.421508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:34.422346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:34.426651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 481/947] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:34.427496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.434745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.436491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:34.456648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:34.457565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:34.458563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:34.458563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:34.458563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:34.458563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:34.461568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 467/948] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:34.467037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.557576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce617b57-1e9a-4873-8b42-8447175a84f9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.597475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01c158-8a40-47a2-85cb-0c7923d30985 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.602283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.603285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.603779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.604298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.605335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:34.605853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.607531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.618662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 482/949] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:34.619896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.622880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.640942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.641750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.642106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.642507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.643408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:34.643824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.645729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.658376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.665961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 468/950] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:34.667033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.749195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9da0-dcf3-4f98-9712-42cec99d9eb5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.785768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bd1f-5f63-4782-8832-fceed97fddf1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.787241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.787903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.788919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.788919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.789228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:34.789540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.790915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577485-d85e-49dc-91dc-e59b3f63f728 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.796162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 483/951] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:34.797370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347022-5a05-4123-98ef-c3231740cf45 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.797665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347022-5a05-4123-98ef-c3231740cf45 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.797948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347022-5a05-4123-98ef-c3231740cf45 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.803249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 484/952] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:34.803249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7347022-5a05-4123-98ef-c3231740cf45 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.830445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.831282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.831569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.831839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.839043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.840548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1f1da2ac-8d15-4c4e-abc6-83bbe900fe6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:34.855056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:34.855923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 469/953] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:34.857479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.858021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.858021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.875128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:34.876461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:34.909192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.918252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7347022-5a05-4123-98ef-c3231740cf45 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:34.919744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:34.949155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 470/954] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:34.950365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:34.969105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:34.970353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:34.971204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:34.971677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:34.972709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:34.974901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.004732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 485/955] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:35.004732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:35.067960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af38c54-b1ad-4e4f-ae58-0146aefe998a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:35.118798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:35.119501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.119855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.120219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.121123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:35.121580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:35.123189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.143018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 471/956] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:35.144118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:35.173947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e0a08-f6bf-4b28-ae0a-aeb1b6e6b47c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:35.183533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:35.217007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:35.218628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.218628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.218628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.219084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:35.224295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:35.240082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:35.241215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:35.242935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 486/957] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:35.248637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:35.272467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:35.275043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1060-c37b-403f-8fcb-a827ab1c5dcf None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:35.324553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:35.326168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.326783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.327075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/ed9c934437f44bdfac79a7fab37a0626/roles/87eab2b33d814fcc81dc388532256356` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.330134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=ed9c934437f44bdfac79a7fab37a0626, role_id=87eab2b33d814fcc81dc388532256356)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:35.331723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.354198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 472/958] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:35 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/ed9c934437f44bdfac79a7fab37a0626/roles/87eab2b33d814fcc81dc388532256356 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:34:35.377057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505db0d-8b9d-45bd-aa26-efd8c6a3ae70 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:35.416976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:35.417787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.417996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.418279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.419003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:35.419314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:35.420803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec3f3-43ec-4f29-9092-921a2f88f2c7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.426978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 487/959] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:35.437323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:35.546583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:35.560876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8c09-78aa-4649-9ec5-239a17263055 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:35.598862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:35.599535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.599824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.600104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.600935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:35.601772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:35.603298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f675d1-8499-4035-bb2d-3b27e78acb0b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:35.612564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 473/960] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:35.931128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9e74-aa42-4e7c-a133-7ea1d4e88a2c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.931507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9e74-aa42-4e7c-a133-7ea1d4e88a2c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.931701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9e74-aa42-4e7c-a133-7ea1d4e88a2c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.933378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 488/961] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:35.938756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:35.939057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:35.939341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:35.956575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:35.957768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:36.037155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 474/962] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:36.065122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9e74-aa42-4e7c-a133-7ea1d4e88a2c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:36.153149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:36.174912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9e74-aa42-4e7c-a133-7ea1d4e88a2c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:36.212113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:36.212763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:36.213100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:36.213384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:36.214126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:36.215692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:36.217098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING keystone.server.flask.common [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 13:34:36.231656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 13:34:36.231656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 13:34:36.231656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [parameters: {'user_id': '4d1ea0c669ad434e9d6933200424106c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 13:34:36.231656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 20 13:34:36.239457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:34:36.240372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 13:34:36.241764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 13:34:36.243478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 13:34:36.245567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 13:34:36.249086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'user_id': '4d1ea0c669ad434e9d6933200424106c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:36.249943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 13:34:36.250725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:36.251646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 489/963] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 20 13:34:36 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:36.252349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:36.339257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:36.357733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197a1de-8a8b-41c9-a649-fb3f90d4c0ec None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:36.393413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:36.394215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:36.394504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:36.394785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:36.402229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:36.403689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-172f3086-6c11-4da0-beea-5bf9d3b500d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:36.418976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:36.420703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:36.421850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 475/964] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:36.428746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:36.544895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cc5b0-98db-413f-8135-f121cb98cbb1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:36.584006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:36.584995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:36.585294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:36.585643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:36.586474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:36.586788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:36.592308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41ea14-9f06-4753-acf0-95205d9e29b2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:36.624034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:36.637828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 490/965] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 20 13:34:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:37.172209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171cda-9044-4efb-b043-f353b6e591cb None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.172519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171cda-9044-4efb-b043-f353b6e591cb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.172805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171cda-9044-4efb-b043-f353b6e591cb None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.174226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 476/966] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:37.179587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.179880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.180163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.197629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:37.199122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:37.267903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 491/967] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:37.290393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57171cda-9044-4efb-b043-f353b6e591cb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.411226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57171cda-9044-4efb-b043-f353b6e591cb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:37.446423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:37.447154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.447502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.447789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.448520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:37.449917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-390806ef-e782-479e-bb0a-af08dc892e93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:37.462656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:37.463654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:37.464523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:37.468360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 477/968] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:37.469884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.487498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e075c-c7a8-4886-bf54-1f021ceccc33 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.487724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e075c-c7a8-4886-bf54-1f021ceccc33 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.488007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e075c-c7a8-4886-bf54-1f021ceccc33 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.493520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 478/969] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:37.494810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.495095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.495376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.512530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:37.513724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:37.515771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:37.577623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea867-a2ae-4b5e-b4de-81ebbdb296c3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:37.588639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 479/970] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:37.606587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.610480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:37.618109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:37.618791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.619078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.619357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.620068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:37.620453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:37.621831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:37.626887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 492/971] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:37.634793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.723865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521cb95-57ab-406e-8165-6e05cb121e2d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:37.757992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a27e-9d3e-46a4-abd1-519868870002 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:37.760994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:37.761873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.762154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.762454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.769465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:37.774769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-08babbd6-5b9b-4835-9050-15c85a2723ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:37.783064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:37.784182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:37.785245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 480/972] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:37.786189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314679-9ab9-450f-80ed-2bc566ce5181 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.786189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314679-9ab9-450f-80ed-2bc566ce5181 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.786189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40314679-9ab9-450f-80ed-2bc566ce5181 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.787338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 481/973] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:37.790680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40314679-9ab9-450f-80ed-2bc566ce5181 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.798915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:37.799574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.799858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.800136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.800880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:37.801183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:37.802551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f28fae-4d15-40e5-93b2-5a02ea09f4ef None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:37.808139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 493/974] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:37.813545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.814264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.814555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.830562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:37.831755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:37.886546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:37.894423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40314679-9ab9-450f-80ed-2bc566ce5181 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:37.901636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 494/975] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:37.902472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.929213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:37.929882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:37.930175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:37.930455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:37.931206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:37.931518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:37.932934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:37.941005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 482/976] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:37.941763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:37.999512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:38.008387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663e0d2-3199-4294-8d84-091e053b1f66 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.042973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.043629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.043914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.044214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.045009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] RBAC: Adding query filter params (interface=admin, service_id=a6a18b0073434ad199e442f712393b01, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:38.045099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb776f-b562-43f6-be1b-c3ed296c4e16 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.045320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.046693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.051629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 495/977] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Jul 20 13:34:37 2022] GET /identity/v3/endpoints?service_id=a6a18b0073434ad199e442f712393b01&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:38.052428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.080547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.081517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.082006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.082296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.083030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.084437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.098737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 483/978] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:37 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:38.099363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.111766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:38.167958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843344be-c783-4313-83c8-a6b5ab57a119 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.213582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.214412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.214700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.214976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.224707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cca7e-0462-4432-baa6-429cfdc2e5ae None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.226549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.228061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.247631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:38.251330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:38.252228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:38.253309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:38.253309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:38.253309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:38.253309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:38.253309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 496/979] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:38.258283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.269694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.270699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.271188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.271624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.272597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.274723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.284015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 484/980] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:34:38.374233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:38.377749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473249f-55dd-43a3-86d3-303fa48f6026 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.415661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.416461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.417072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.417355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.418195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:38.418505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.419941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.433396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 497/981] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:38.439262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.545372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8ea2-ce49-4de1-8c2e-394b8421b12e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.580043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.580896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.581188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.581470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.589312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.590779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:38.606890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:38.607885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:38.608881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 485/982] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:38.614022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.721920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d115b-4adb-407c-8661-3af686bd798b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.757099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.757806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.758096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.758373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.759207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:38.759521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.760990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:38.779566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 498/983] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:38.785476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:38.834083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:38.889876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b7706-2ede-44ea-a64c-e1244d900693 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:38.923874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:38.924548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:38.924838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:38.925115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:38.992400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:38.993862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.037429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:39.098114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 486/984] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:34:39.099212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:39.118898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:39.201313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d89dd-0e11-43bf-b4e9-35c351742e76 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:39.236673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:39.237491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:39.237777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:39.238059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:39.249629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:39.251109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:39.269393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:39.270274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:39.276796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:39.276796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:39.276796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:39.276796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:39.276796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 499/985] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:39.277094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:39.377868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e02eb1-7322-4d21-8360-2b06c106a71d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:39.413092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:39.413781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:39.414069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:39.414342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:39.415057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:39.415364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:39.416763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.428379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 487/986] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:39.433860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:39.504461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:39.536960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a0a1-be85-43d2-93c2-8383111027c5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:39.570576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:39.571364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:39.571648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:39.571922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:39.578776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:39.580245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:39.594370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:39.595239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:39.596123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:39.600232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 500/987] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:39.601465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:39.605415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:39.714699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6688-0f3a-47ef-acc7-e9740f2d9cac None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:39.749788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:39.750448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:39.750743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:39.751022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:39.751806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:39.752118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:39.753588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eab2c0-b54a-4af7-840c-d7e7c0762e9f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.770799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 488/988] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:39.772360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:39.875801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683130-bd0a-4f78-88df-2da0c292eb92 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:39.904322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:39.911165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:39.911817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:39.912099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:39.912403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:39.913230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] RBAC: Adding query filter params (role.id=87eab2b33d814fcc81dc388532256356, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=ed9c934437f44bdfac79a7fab37a0626) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:39.914154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:39.915574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa88703-793d-4afe-bbbd-e94db44d02d4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:39.928277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 501/989] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:39 2022] GET /identity/v3/role_assignments?user.id=ed9c934437f44bdfac79a7fab37a0626&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=87eab2b33d814fcc81dc388532256356 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:40.175728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9024-0f24-4cd3-994a-2ff131f471e6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.175997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9024-0f24-4cd3-994a-2ff131f471e6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.176216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9024-0f24-4cd3-994a-2ff131f471e6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.177624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 489/990] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:40.183289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba21d9-14dc-427e-9c11-56b6d9ef7a64 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.183592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba21d9-14dc-427e-9c11-56b6d9ef7a64 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.183880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba21d9-14dc-427e-9c11-56b6d9ef7a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.200947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-86ba21d9-14dc-427e-9c11-56b6d9ef7a64 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:40.202145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-86ba21d9-14dc-427e-9c11-56b6d9ef7a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:40.270051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 502/991] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:40.293023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9024-0f24-4cd3-994a-2ff131f471e6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.360255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:40.390421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eabb8-62a8-4421-af29-f324653f103c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.390713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eabb8-62a8-4421-af29-f324653f103c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.391000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eabb8-62a8-4421-af29-f324653f103c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.392418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 503/992] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:40.398567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.399192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.399509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.403613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9024-0f24-4cd3-994a-2ff131f471e6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.418277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:40.419567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:40.441938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.442662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.442950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.443227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.443878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.445292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:40.457178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:40.458183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:40.459008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 490/993] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:40.464629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.504479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 504/994] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:40.519585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.570531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6435d-8452-4c11-b11a-2a7077ffa64b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.583009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:40.596638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:40.604903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.605595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.605853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.606132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.606832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:40.607144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.608550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.618358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 491/995] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:40.619396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.643390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981780-9325-4bc4-b821-e1f2169b1dd7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.680500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.681307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.681592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.681867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.682933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.684352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:40.697130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:40.698104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:40.698932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 505/996] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:40.704759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.736733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ee2f-be71-44bc-845f-9f08cb9eb5eb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.771160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.771901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.772219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.772497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.773224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:40.773536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.774910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.780001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 492/997] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:40.785494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.816880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640184-f02e-476d-94e5-aa990b62c730 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.834372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:40.846614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:40.853658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.854325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.854614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.854891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.855604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:40.855916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.857318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.864361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 506/998] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:40.870017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.901429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9fa30-a047-4363-a392-01d8f5f9f32c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:40.934583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:40.935227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:40.935518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:40.935793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:40.936606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] RBAC: Adding query filter params (interface=public, service_id=c57cb08b25f94abf9330e944ae9195ce, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:40.936917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:40.938284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:40.948070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 493/999] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/endpoints?service_id=c57cb08b25f94abf9330e944ae9195ce&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:40.948997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:40.980035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908430-a63a-4f91-9813-ba1ad0f7804e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:41.013894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:41.014552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:41.014837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:41.015114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:41.015811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:41.016125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:41.017511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:41.024239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 507/1000] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:41.029305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:41.054431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd275e2-4610-4adc-860c-9368e2b19d3b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:41.078073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:41.078449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:41.094787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:41.095456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:41.095737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:41.096012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:41.096827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:41.098299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cac9e-1a16-489c-989f-c605e4e2e37d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:41.105209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 494/1001] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:40 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:34:41.138617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53063a-9bfd-4ac2-b1f5-d5b5d8ead752 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:41.176757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:41.177430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:41.177798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:41.178083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:41.178833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:41.180308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0429444-c3ab-4e96-b1f5-cc3c35b2adbb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:41.204325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 508/1002] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:42.020862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df93cd-fb37-4e11-8538-8f348812f418 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:42.021384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df93cd-fb37-4e11-8538-8f348812f418 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:42.021461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df93cd-fb37-4e11-8538-8f348812f418 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:42.023384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 495/1003] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:42.028454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:42.028828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:42.029024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:42.045376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:42.046574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:42.117657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 509/1004] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:42.139922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df93cd-fb37-4e11-8538-8f348812f418 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:42.246902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df93cd-fb37-4e11-8538-8f348812f418 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:42.281539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:42.282257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:42.282544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:42.282823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] PATH_INFO: `/v3/services/image` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:42.283478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:42.284880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:42.297720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:42.298706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:42.299531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:42.301040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 496/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 20 13:34:42 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:42.305439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:42.339457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:42.411003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca93f5-88d1-4ce8-8eff-b754e838a870 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:42.450043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:42.450971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:42.451260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:42.451544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:42.452277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] RBAC: Adding query filter params (name=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:42.452592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:42.453966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29def5-8b7b-4734-b953-125231642d2a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:42.458884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 510/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:42.464937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:42.513497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:42.565247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7755-bf14-4986-8c78-69b05a208773 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:42.599449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:42.600115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:42.600434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:42.600733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:42.601450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] RBAC: Adding query filter params (type=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:42.601764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:42.603149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7df3a-a670-4bcd-99cc-e6201c18a249 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:42.607818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 497/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:43.141800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559329-6b98-4099-9e3c-36f4e136c847 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.142324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559329-6b98-4099-9e3c-36f4e136c847 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.142432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559329-6b98-4099-9e3c-36f4e136c847 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.143757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 511/1008] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:43.149515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634850e-bb14-438c-ab41-93fa7ce567a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.149902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634850e-bb14-438c-ab41-93fa7ce567a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.150081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634850e-bb14-438c-ab41-93fa7ce567a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.166571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e634850e-bb14-438c-ab41-93fa7ce567a1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:43.167750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e634850e-bb14-438c-ab41-93fa7ce567a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:43.236378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 498/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:43.259500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559329-6b98-4099-9e3c-36f4e136c847 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.261412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28403-6d67-4218-a69f-22e60e8413c7 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.261709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28403-6d67-4218-a69f-22e60e8413c7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.261987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28403-6d67-4218-a69f-22e60e8413c7 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.263457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 499/1010] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:43.268303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.268590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.268873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.286077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:43.287172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:43.325265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:43.359765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 500/1011] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:43.369226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:43.376832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559329-6b98-4099-9e3c-36f4e136c847 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.384970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.415325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.416048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.416352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.416623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.417279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.418647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:43.431088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:43.432096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:43.437096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 512/1012] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:43.438319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.499265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e5b6-139e-4d1e-9dc1-0f0d571febac None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.536804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.537601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.537885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.538159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.539355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.540832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.544254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 501/1013] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:43.548567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.551175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587fba1-a1eb-4114-b731-b0f50949c5e9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.589720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.590391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.590682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.590965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.591671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] RBAC: Adding query filter params (name=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:43.591981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.593390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.598488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 513/1014] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:43.604813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.605154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:43.636904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:43.674159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998d-511a-4e29-93cb-f9e0cd7a84ed None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.712138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.712889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.713179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.713465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.714195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.715677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.718988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb90f6-8977-4116-9a1d-0c6501ec603c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.744621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 502/1015] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:43 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:43.760864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.761558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.761846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.762125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.762855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:43.763170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.764626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f573e5-fd2f-4985-9bb6-004bdb169500 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.778128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 514/1016] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 20 13:34:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:43.779420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:43.880644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:43.891087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04286e1-cabb-44c5-88f3-03e0532a159d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:43.927802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:43.928427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:43.928716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:43.929630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:43.930371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:43.931746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2128a-3d8f-4233-b05f-7bee1eb4a0ad None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:43.951688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 503/1017] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:44.647272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303107e6-bc73-42ee-8b8f-aba0433162ec None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:44.647272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303107e6-bc73-42ee-8b8f-aba0433162ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:44.647272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303107e6-bc73-42ee-8b8f-aba0433162ec None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:44.648532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 515/1018] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:44.653254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb14fa-ca26-4060-ab84-d6c357261303 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:44.653647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb14fa-ca26-4060-ab84-d6c357261303 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:44.653832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb14fa-ca26-4060-ab84-d6c357261303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:44.670338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-36eb14fa-ca26-4060-ab84-d6c357261303 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:44.671510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-36eb14fa-ca26-4060-ab84-d6c357261303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:44.746436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 504/1019] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:44.768431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303107e6-bc73-42ee-8b8f-aba0433162ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:44.860956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:44.875002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303107e6-bc73-42ee-8b8f-aba0433162ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:44.911504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:44.912173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:44.912493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:44.912776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:44.914097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:44.915479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672c77-b81b-4798-a29e-82e781bedf74 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:44.930891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 516/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:34:44 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:34:45.830299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f35-357d-405d-8ead-850821047386 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:45.830834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f35-357d-405d-8ead-850821047386 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:45.830912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f35-357d-405d-8ead-850821047386 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:45.832303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 505/1021] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:45.838281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560008c-89f9-47ba-9dc4-74a98f6a99d8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:45.838665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560008c-89f9-47ba-9dc4-74a98f6a99d8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:45.838852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560008c-89f9-47ba-9dc4-74a98f6a99d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:45.856174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f560008c-89f9-47ba-9dc4-74a98f6a99d8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:45.857385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f560008c-89f9-47ba-9dc4-74a98f6a99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:45.932822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 517/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:45.956866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56f35-357d-405d-8ead-850821047386 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.035227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:46.065822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56f35-357d-405d-8ead-850821047386 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.074983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd925e-385a-4a65-bdba-889c4face434 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.075276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd925e-385a-4a65-bdba-889c4face434 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.075557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd925e-385a-4a65-bdba-889c4face434 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.077372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 518/1023] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:46.081968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.082255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.082530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.099403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:46.100658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:46.102806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.103620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.103906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.104185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.105400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:46.106841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:46.113189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 506/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:46.114480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.170884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 519/1025] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:46.194477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.198126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:46.222982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c5033-4c5f-47ac-b5e7-77161da1c48e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.261351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.262006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.262296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.262569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.263271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:46.264738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:46.280794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:46.289229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 507/1026] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:34:46 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:34:46.306905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec34dd-9440-471e-a9cf-7575898361b0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.347469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.348326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.348614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.348889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.361038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:46.370073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:46.371085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:46.376997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 520/1027] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:46.377694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.489052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3640f4-8627-4edf-8d34-c25ad273c013 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.542984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.544324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.544324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.544324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.545068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:46.545375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:46.546753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:46.560232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 508/1028] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:46.563773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.627473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:46.673660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37bfc-64c6-4a51-830b-ee28b82ffdba None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.708828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.709628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.709919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.710730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.721790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:46.723337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:46.741486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:46.742362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:46.743240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:46.743240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:46.743240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:46.743240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:46.744259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 521/1029] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:46.748328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.809430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:46.858496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f80a-ab03-4b6b-8d43-7149d8ce176a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:46.893016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:46.893686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.893974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.894254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.895117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:46.900106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:46.901527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794478f-772d-469e-9159-9cd5189d32db None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:46.926622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 509/1030] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:46.927907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:46.982721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2bbfa-b6d7-41e1-b213-7cfc0f84ec49 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.983043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2bbfa-b6d7-41e1-b213-7cfc0f84ec49 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.983295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2bbfa-b6d7-41e1-b213-7cfc0f84ec49 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:46.985283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 510/1031] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:46.989996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:46.990296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:46.990647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.009113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:47.010242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:47.038573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd58d-cd0b-4ebf-a6bb-7de5096d4560 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.054992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.075838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.076780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.077068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.077347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.083840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 511/1032] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:47.085380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.086825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:47.100962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:47.101892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:47.107669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 522/1033] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:47.108331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.108409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.160487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.215157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555295c8-2d5a-4bc8-9add-d17c1d6975c0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.223381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca56591-e2fc-4a0c-b930-352c4cf2e8da None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.256712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.257524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.257809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.258078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.258722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.260144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.270970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:47.271634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:47.273157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:47.273989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:47.274757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.274757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.274757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.274757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:47.274757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.275625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.278289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 512/1034] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:47.279028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.294922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 523/1035] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:47.300533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.337250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.389987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e91ca-5a52-4cb4-a6bd-2c37aef857d4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.405339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.409504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbebd6f-caf0-4dbd-88bd-2385c3da94c1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.430352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.431027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.431316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.431597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.432346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] RBAC: Adding query filter params (name=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:47.432661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.434048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.443729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 513/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:47.444844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.452118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.452935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.453233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.453505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.538582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.540156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.560047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71db1b-9dde-4128-a388-829740b9db77 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.574808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.599892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.600967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.601534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.601819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.602540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] RBAC: Adding query filter params (type=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:47.602854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.604466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.614179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 514/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:47.615226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.652367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 524/1038] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:47.653398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.674033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.739863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c7dd8-da95-4cd5-8c0c-6c5bc6b4179e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.752979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94586a6-e9c4-44a0-827e-9b3e301123e4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.777230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.777886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.778294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.778581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.779492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] RBAC: Adding query filter params (interface=public, service_id=2575cd28bace4bba9057e5be235f205c, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:47.779810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.781335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.786517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.791594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 515/1039] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/endpoints?service_id=2575cd28bace4bba9057e5be235f205c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:47.791696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.791696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.791696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.791696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.792435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.801574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.803033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:47.820983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:47.821901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:47.827767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:47.827767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:47.827767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:47.827767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:47.827767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 525/1040] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:47.828050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:47.907670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2026d-dc82-4189-8bf0-94714338e6b4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.916964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:47.937473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2afe87-20a3-4756-ad80-080dfc4d4e85 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:47.949395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.950202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.950493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.951027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.951704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.953164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.960454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 516/1041] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:34:47.974617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:47.975317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:47.975671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:47.976488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:47.977237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:47.977551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:47.978965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:47.992470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 526/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:47.997953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.108539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b4c69-fabe-41dd-9a96-e439be44b8e0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:48.144511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:48.145303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.145595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.145869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.152842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:48.154289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:48.168016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:48.168947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:48.169871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 517/1043] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:48.175180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.222574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:48.277372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5fc7-ac6b-43a7-9993-71b5187fafc6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:48.310237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:48.310895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.311181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.311458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.312259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:48.312571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:48.313996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9863-9ce0-4446-b378-b39e4f4d12cd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:48.333638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 527/1044] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:48.334883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.367534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:48.414218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221197b5-60cb-4f9f-8be4-dffe42a20f84 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.414562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221197b5-60cb-4f9f-8be4-dffe42a20f84 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.414792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221197b5-60cb-4f9f-8be4-dffe42a20f84 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.416178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 528/1045] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:48.421778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.422073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.422351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.442676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:48.442867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e982-2356-4b5c-a49b-bf63e099816a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:48.443725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:48.478797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:48.479488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.479778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.480062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.480924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] RBAC: Adding query filter params (role.id=87eab2b33d814fcc81dc388532256356, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:48.481247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:48.482691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:48.488319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 518/1046] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:48 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=87eab2b33d814fcc81dc388532256356 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:48.518484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 529/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:48.542918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.654627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:48.662022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4563-9863-4c64-be94-d82578cc223f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:48.697367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:48.698161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.698445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.698723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.709262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:48.716863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:48.717919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:48.718757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 519/1048] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:48.725597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.761540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:48.828214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cb79f-3577-4376-b5af-3946ca44e08d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:48.861098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:48.861762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:48.862048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:48.862324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:48.863057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:48.863361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:48.864753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:48.878109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 530/1049] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:48.879499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:48.981212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67316-ab8c-4c4f-bec9-6553920c18cc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:49.014758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:49.015637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:49.015918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:49.016217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] PATH_INFO: `/v3/users/4bbe9f43c49d46a9b8cc2936c7303401` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:49.029596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] RBAC: Authorizing `identity:get_user(user_id=4bbe9f43c49d46a9b8cc2936c7303401)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:49.031036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:49.032878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 520/1050] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:34:48 2022] GET /identity/v3/users/4bbe9f43c49d46a9b8cc2936c7303401 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:49.038916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:49.139532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:49.143814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a864-e2b4-4720-aac6-30b92e31a5ea None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:49.178734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:49.179388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:49.179672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:49.179948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:49.248841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:49.250210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:49.342627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:49.352345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 531/1051] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:34:49.354303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:49.369461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:49.454921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c64b5-925f-42b1-806c-b64cde65e65d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:49.492470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:49.493330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:49.493612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:49.493886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:49.495066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:49.496616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e495a31-4504-4b81-a21c-a686f4d5fcc0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:49.498480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 521/1052] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:34:49 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:49.504449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:49.607437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a72a5c-4627-41e5-9470-f56d1c320920 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:49.651415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:49.652077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:49.652383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:49.652660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:49.653499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e, user.id=4bbe9f43c49d46a9b8cc2936c7303401) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:49.653810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:49.655248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a7a1-fb6a-4c8a-a49d-b25e307c89ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:49.661288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 532/1053] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:49 2022] GET /identity/v3/role_assignments?user.id=4bbe9f43c49d46a9b8cc2936c7303401&scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:50.044357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11277-7ab3-4d9a-8b04-1779dfb71eb7 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.044883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11277-7ab3-4d9a-8b04-1779dfb71eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.044959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11277-7ab3-4d9a-8b04-1779dfb71eb7 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.046426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 522/1054] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:50.051535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.051959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.052142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.068670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:50.070393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:50.131202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:50.143457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 533/1055] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:50.166214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe11277-7ab3-4d9a-8b04-1779dfb71eb7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.251133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:50.273288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe11277-7ab3-4d9a-8b04-1779dfb71eb7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.307542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.308285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.308578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.308858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] PATH_INFO: `/v3/services/image` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.309514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:50.310883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:50.323127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:50.324607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 13:34:50.325494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:50.328576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 523/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:50.331124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.433065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc875bc-7982-4a5a-92e5-1b0ce1d1c756 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.469463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.470123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.470406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.470678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.471371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] RBAC: Adding query filter params (name=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:50.471675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:50.473075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef56f72-ef91-449e-b019-2f6611057a79 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:50.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 534/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:50.484066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.494857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dd29b-c1a4-4232-975e-19c046a610b7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.495147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dd29b-c1a4-4232-975e-19c046a610b7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.495433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dd29b-c1a4-4232-975e-19c046a610b7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.496838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 535/1058] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:50.501719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.502011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.502292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.522602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:50.523784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:50.576447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:50.589695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe16e-5549-4020-866a-8423a03fe78e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.594323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 536/1059] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:50.617513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.627167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.627835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.628120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.628429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.629132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:50.629442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:50.632278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:50.637632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 524/1060] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:50.643293 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.655016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:50.739417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcd3a9-2b59-42f8-9042-a0a28aa6f9d2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.750069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c0484-85aa-4363-8611-2844114ad7a9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.777825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.778630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.778915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.779190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.789002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.789667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.789959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.790068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:50.790240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.790981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:50.792391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:50.798179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:50.799101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:50.801189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 537/1061] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:50.805517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:50.824879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 525/1062] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:34:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:34:50.858731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:50.916874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95bd2-8d2c-4f81-b8fe-cffcfaa29b2b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:50.959125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:50.960699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:50.960699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:50.960699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:50.961127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:50.961424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:50.962791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:50.975930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 538/1063] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:50.977300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.043499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:51.084709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ed038-1a00-4cb7-a692-1a5520ecd6d5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.119289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.120014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.120333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.120616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.131242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:51.133331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:51.150454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:51.151356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:51.152241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:51.152241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:51.152241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:51.152241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:51.152241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 526/1064] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:51.157468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.261205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec337b9e-e970-494c-b5f5-799003c0863a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.263548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:51.296849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.297514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.297795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.298066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.298777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:51.299079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:51.300467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:51.316301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 539/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:51.318558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.419350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2251-d760-4b18-a5cd-6e3ca4cab2ff None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.435123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:51.454452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.455240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.455522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.455796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.463909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:51.465396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:51.479430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:51.480428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:51.481363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:51.484295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 527/1066] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:51.486664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.589717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a19f0-4d9e-41ae-a25a-916de8d7f866 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.623942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.624639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.624924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.625200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.626017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:51.626324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:51.627746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3028b-2921-4e25-a458-9e1469a80cde None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:51.651237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 540/1067] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:51.657081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.716090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048fbeb-03ef-484c-9192-9073d2eaea25 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.716410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048fbeb-03ef-484c-9192-9073d2eaea25 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.716609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048fbeb-03ef-484c-9192-9073d2eaea25 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.718105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 541/1068] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:51.722685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.723206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.723421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.739985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:51.741739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:51.759756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:51.764395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378947-a172-48ac-a245-e14525709bcd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.804703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.805708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.806136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.806635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.814200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 542/1069] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:51.818710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:51.820341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:51.837466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:51.839047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:51.840038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:51.840978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:51.840978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:51.840978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:51.840978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:51.846471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 528/1070] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:51.847925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:51.878294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:51.943996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebe119-b317-41a3-a1bf-75951f7e16ab None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.963077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52754ea-6bae-406d-a630-b41c3242f821 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:51.984300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:51.984999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:51.985553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:51.985679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:51.997604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:51.999473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.000136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.000449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.000726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.001444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:52.001752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.003118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:52.005711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:52.011567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 543/1071] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:52.012488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.018982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 529/1072] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:52.024464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.028991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:52.109458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:52.121394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7fcc-524c-446b-9d58-0dbd9947c56a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.123645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025185-ba16-440f-97f2-e6e77f3259e2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.155435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.156096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.156409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.156694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.157429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:52.157738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.158719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.159106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.159841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.160303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.160721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.167610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 544/1073] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:52.168265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.169700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.173280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:52.185805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:52.186756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:52.187636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 530/1074] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:52.192768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.248942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:52.273789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a35487-e222-48a5-b343-6ca8fa4583b9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.302234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee935f7-7286-425f-bbb9-cab396cd8a7d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.307390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.308290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.308576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.308852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] PATH_INFO: `/v3/users/4bbe9f43c49d46a9b8cc2936c7303401` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.310058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] RBAC: Authorizing `identity:get_user(user_id=4bbe9f43c49d46a9b8cc2936c7303401)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.311494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.313332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 545/1075] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:34:52 2022] GET /identity/v3/users/4bbe9f43c49d46a9b8cc2936c7303401 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:52.318787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.340206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.340993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.341280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.341555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.342339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:52.342650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.344373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.359230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 531/1076] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:52.365216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.376253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:52.423405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0287ab-7703-4d86-a916-c1067f39684c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.457728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.458587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.458867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.459142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.460861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.462295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.463995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 546/1077] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:34:52 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:52.471168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:52.473731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863b1f-cf71-479c-926f-3f2cef8fdbec None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.484390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:52.512033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.513191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.513627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.514055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/87eab2b33d814fcc81dc388532256356` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.516480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=c6dcc9d0442c49c3ab0f852b91dce5f9, role_id=87eab2b33d814fcc81dc388532256356)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.517928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8939db-1f45-4f8c-b66d-1b77799374f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.531867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 532/1078] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:52 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/c6dcc9d0442c49c3ab0f852b91dce5f9/roles/87eab2b33d814fcc81dc388532256356 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:34:52.592741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a868-2737-4a38-bc3e-bb1c77b2bcb4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:52.629494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:52.632230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.632230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.632230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e/users/4bbe9f43c49d46a9b8cc2936c7303401/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.633745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=12aa4c7c2e3241f4ae140da14130ef3e, user_id=4bbe9f43c49d46a9b8cc2936c7303401, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:52.634533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5484f-745f-4fc0-a029-780a7fbc2b2e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:52.655739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 547/1079] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:34:52 2022] PUT /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e/users/4bbe9f43c49d46a9b8cc2936c7303401/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:34:52.910843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de49cf-98af-430c-9419-8d6bbff15ba1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.911217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de49cf-98af-430c-9419-8d6bbff15ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.911449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de49cf-98af-430c-9419-8d6bbff15ba1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.913014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 533/1080] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:52.917941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:52.918245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:52.918534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:52.935369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:52.936598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:53.004272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:53.012275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 548/1081] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:53.032650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de49cf-98af-430c-9419-8d6bbff15ba1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:53.102896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:53.140176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de49cf-98af-430c-9419-8d6bbff15ba1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:53.174822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:53.175391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:53.175674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:53.175950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:53.244511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:53.245984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:53.324355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:53.364705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 534/1082] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:34:53.366905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:53.467059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b997-461c-43ed-b099-f849310838e2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:53.500122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:53.500934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:53.501221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:53.501499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:53.511871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:53.513385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-39546791-1896-4f5c-82fd-a0f923893793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:53.530783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:53.531645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:53.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:53.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:53.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:53.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:53.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 549/1083] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:53.538684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:53.661863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328aee5-ba57-4a87-92f5-0f466ab77efb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:53.698222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:53.699245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:53.699772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:53.700281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:53.701469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:53.701975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:53.703541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b82fdb-ce34-40cc-9206-c8407e516eac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:53.715340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 535/1084] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:54.597991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa484b-634e-4c40-b80c-12e30cf765a8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.598522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa484b-634e-4c40-b80c-12e30cf765a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.598716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa484b-634e-4c40-b80c-12e30cf765a8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:54.600039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 550/1085] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:54.605273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8b4f-b763-4334-8085-91c051c3bf79 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.605701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8b4f-b763-4334-8085-91c051c3bf79 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.605846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8b4f-b763-4334-8085-91c051c3bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:54.622881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-924f8b4f-b763-4334-8085-91c051c3bf79 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:54.624066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-924f8b4f-b763-4334-8085-91c051c3bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:54.649750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:54.693932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 536/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:54.717473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa484b-634e-4c40-b80c-12e30cf765a8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:54.744661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29418c-08b1-4fac-9628-3334b6056bb6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.744957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29418c-08b1-4fac-9628-3334b6056bb6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.745239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29418c-08b1-4fac-9628-3334b6056bb6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:54.746602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 537/1087] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:34:54.751554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.751841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.752316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:54.769159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:54.770350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:54.770820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:54.818327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa484b-634e-4c40-b80c-12e30cf765a8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:54.837500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 538/1088] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:34:54.854111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:54.854855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.855145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.855431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:54.860388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:54.865614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:54.874461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:54.875409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:54.876279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 551/1089] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 20 13:34:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:54.881556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:54.946302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:54.959163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb647a5-faa9-44c5-9b00-5b12d0b2ff9b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:54.980784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703df6-9b40-48c0-b827-93c650848a18 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:54.993268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:54.993479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:54.994643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:54.994991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:54.995371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.005621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:34:55.013810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:55.014923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:55.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 539/1090] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:55.017507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.018167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.018451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.018728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.019466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:55.019772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.021182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.021281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.034106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 552/1091] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:34:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.035119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.121177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76c40-18fb-4eeb-9ad5-94cfef24666a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.133917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c43d-277d-4dc6-91b5-b86e5bb3a1db None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.154501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.155170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.155454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.155727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.156497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:55.156807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.158174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.166707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.166902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 540/1092] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.167500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.167846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.168134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.172426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.179676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.181157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.184828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:55.198750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:55.199790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:55.200976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:55.200976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:55.200976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:55.200976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:55.200976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 553/1093] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:55.205783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.233364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.271850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fffc49-5f16-4f08-a067-87f8d4438800 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.305378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.306247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.306532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.306807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] PATH_INFO: `/v3/users/4bbe9f43c49d46a9b8cc2936c7303401` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.307082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e254e2-a89a-4a1e-87d6-286ed2ee9fb8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.307985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] RBAC: Authorizing `identity:get_user(user_id=4bbe9f43c49d46a9b8cc2936c7303401)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.309686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.311464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 541/1094] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/users/4bbe9f43c49d46a9b8cc2936c7303401 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.317086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.344054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.344751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.345042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.345323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.346048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:55.346363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.347748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.359932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 554/1095] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.365525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.395891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.417934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec995f0-2716-4420-8f2c-c126c431ab80 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.448696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.452211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.452885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.453178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.453459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.465453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec757-0a8a-4c08-be12-6656d865e554 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.499352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.500140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.500451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.500729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.507795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.509280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.519765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.521245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:34:55.523799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:55.524831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:34:55.526352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 555/1096] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:55.530667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.604096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.626875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 542/1097] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:55.632252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3c66-ed7e-4f90-8749-e746d297e839 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.633002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.666743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.667338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.667623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.667898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.668760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:55.669074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.670507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.687560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 556/1098] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.693278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.696679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.733975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977c5e1-7b71-4b24-bf6a-8cf1eab71212 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.768020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.768894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.769180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.769456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.770639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.772066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.773815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 543/1099] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:55.779785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:55.790128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5b52c-7b76-4fc8-980c-8077bdbafaa7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.823875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.824553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.824837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.825105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.826051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.878914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031fc29-0451-42d2-b0ba-ff0ae48af66a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:55.891668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.893159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.895693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:55.914339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:55.914987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:55.915274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:55.915551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:55.916416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e, user.id=4bbe9f43c49d46a9b8cc2936c7303401) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:55.916732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:55.918214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:55.924065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 544/1100] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/role_assignments?user.id=4bbe9f43c49d46a9b8cc2936c7303401&scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:55.995808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 557/1101] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:34:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:34:56.001697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:56.106791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a316757-529a-4bd0-a240-9a90fa169bdc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:56.117993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:56.143547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:56.144370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:56.144655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:56.144930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:56.155373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:56.156847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:34:56.173418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:56.174451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:56.175530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:34:56.175530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:34:56.175530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:34:56.175530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:56.175530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 545/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:34:56.180725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:56.278934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade931-c8e1-4ed7-8ba3-10358ae9502a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:56.281445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:56.313057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:56.313713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:56.314002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:56.314278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:56.314989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:56.315293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:56.316734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:56.328819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 558/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:34:56.334488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:56.440707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6d954-10fb-467a-ae97-434cbc56fda4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:56.475989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:56.476852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:56.477149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:56.477429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:56.484533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:56.485993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:34:56.502828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:34:56.503840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:34:56.504787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 546/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:34:56.509981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:56.608718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec8fdf-3830-432f-978a-84adfc13239a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:56.642053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:56.642726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:56.643016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:56.643299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:56.644096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:56.644440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:56.646030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54afc-66b5-422b-b8d6-f1ee7bbafb3e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:56.658547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 559/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:56.665126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:56.689451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:56.764014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620287-893b-4682-8548-4e484979c8c2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:56.796997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:56.797636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:56.797922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:56.798203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:56.799024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] RBAC: Adding query filter params (role.id=87eab2b33d814fcc81dc388532256356, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=c6dcc9d0442c49c3ab0f852b91dce5f9) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:34:56.799337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:56.800798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5a545-49fb-4d84-9ff8-48627d7372b4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:56.806483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 547/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:34:56 2022] GET /identity/v3/role_assignments?user.id=c6dcc9d0442c49c3ab0f852b91dce5f9&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=87eab2b33d814fcc81dc388532256356 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:57.980230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa385f9-b4f0-4a73-915a-b4202e1b75ab None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:57.980749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa385f9-b4f0-4a73-915a-b4202e1b75ab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:57.980865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa385f9-b4f0-4a73-915a-b4202e1b75ab None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:57.982143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 560/1107] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:34:57.987213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:57.987596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:57.987785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:58.004051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:34:58.005274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:34:58.069630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 548/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:34:58.094097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa385f9-b4f0-4a73-915a-b4202e1b75ab None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:58.120375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:58.198139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa385f9-b4f0-4a73-915a-b4202e1b75ab None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:58.231925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:58.232680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:58.232973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:58.233253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:58.234420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:58.235860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84307b3-ba5b-43c3-a70b-b61326b81511 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:58.237501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 561/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:34:58.243289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:34:58.260713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:34:58.341240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2d82-ae1b-4765-a8f4-d415837a1561 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:34:58.374176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:34:58.374834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:34:58.375121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:34:58.375400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:34:58.376104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:34:58.377562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aa7be-18d4-40c0-abd7-641f4e59c141 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:34:58.396651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 549/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:34:58 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:00.419930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838960af-9245-4579-b6f2-a9e009881d6a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:00.420555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838960af-9245-4579-b6f2-a9e009881d6a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:00.420555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838960af-9245-4579-b6f2-a9e009881d6a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:00.421868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 562/1111] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:00.426903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:00.427292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:00.427466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:00.445129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:00.446299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:00.510971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 550/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:00.534097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838960af-9245-4579-b6f2-a9e009881d6a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:00.622776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:00.632414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838960af-9245-4579-b6f2-a9e009881d6a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:00.666424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:00.667265 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:00.667548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:00.667823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] PATH_INFO: `/v3/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:00.669307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] RBAC: Authorizing `identity:get_role(role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:00.670722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:00.672027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 563/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:00 2022] GET /identity/v3/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:00.677783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:00.679954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:00.777206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ea45b-3287-4798-a2ec-4a2c503e2646 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:00.811825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:00.812718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:00.813007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:00.813286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] PATH_INFO: `/v3/users/bac3e8ade10142759d453c8e8eab3af6` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:00.827695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] RBAC: Authorizing `identity:get_user(user_id=bac3e8ade10142759d453c8e8eab3af6)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:00.829223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:00.831129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 551/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:00 2022] GET /identity/v3/users/bac3e8ade10142759d453c8e8eab3af6 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:00.836913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:00.939366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dcd2-4512-4e69-8ea2-63030d3f2e1c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:00.973596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:00.974244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:00.974531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:00.974810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:01.002297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:01.041644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:01.043094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:01.136661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 564/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:01.142573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:01.201723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:01.242030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75187f7-a309-4481-bc1f-6a5037fa06c5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:01.275922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:01.276799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:01.277088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:01.277368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:01.278547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:01.279994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3763b8-31aa-48fa-9a9b-cadf5590e3ba None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:01.281726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 552/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:01 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:01.287997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:01.348709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:01.389405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aae7a-3437-4eb6-af8b-34511272705e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:01.422150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:01.422799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:01.423086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:01.423368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:01.424218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e, user.id=bac3e8ade10142759d453c8e8eab3af6) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:01.424535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:01.425970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd567aa-76f2-4897-9896-0ddba0f2b8d9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:01.431907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 565/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:01 2022] GET /identity/v3/role_assignments?user.id=bac3e8ade10142759d453c8e8eab3af6&scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:03.457890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784e15-7fa4-4e74-b8e9-7e2f22ac0d01 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:03.458439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784e15-7fa4-4e74-b8e9-7e2f22ac0d01 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:03.458439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784e15-7fa4-4e74-b8e9-7e2f22ac0d01 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:03.459818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 553/1118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:03.464881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:03.465270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:03.465453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:03.482304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:03.483484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:03.550018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 566/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:03.573210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784e15-7fa4-4e74-b8e9-7e2f22ac0d01 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:03.676499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784e15-7fa4-4e74-b8e9-7e2f22ac0d01 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:03.701818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:03.710369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:03.711157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:03.711441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:03.711717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] PATH_INFO: `/v3/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:03.713191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] RBAC: Authorizing `identity:get_role(role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:03.714555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:03.715912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 554/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:03 2022] GET /identity/v3/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:35:03.721798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:03.775961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:03.818637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d42ac-e0a8-4fdd-ad47-75eb70505841 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:03.852012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:03.852903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:03.853194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:03.853473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] PATH_INFO: `/v3/users/bac3e8ade10142759d453c8e8eab3af6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:03.854651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] RBAC: Authorizing `identity:get_user(user_id=bac3e8ade10142759d453c8e8eab3af6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:03.856088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:03.857738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 567/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:03 2022] GET /identity/v3/users/bac3e8ade10142759d453c8e8eab3af6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:03.863364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:03.960663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25275-b228-4181-8dcc-a576d6765437 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:03.992325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:03.993161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:03.993449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:03.993728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:03.994885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:03.996415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae38e8-136a-42bd-839f-c7d3b7a073a0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:03.998075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 555/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:03 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:04.004071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:04.102277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409547-9c78-45fc-8c9f-e36b8f1691db None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:04.124650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:04.137015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:04.137890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:04.138176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:04.138453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e/users/bac3e8ade10142759d453c8e8eab3af6/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:04.140659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] RBAC: Authorizing `identity:create_grant(project_id=12aa4c7c2e3241f4ae140da14130ef3e, user_id=bac3e8ade10142759d453c8e8eab3af6, role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:04.142184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf90a-c947-41e6-952a-fd3f31e0973b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:04.154779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 568/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:35:04 2022] PUT /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e/users/bac3e8ade10142759d453c8e8eab3af6/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:35:06.152094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc072f1-76d0-4de9-b8f4-2aa823a7a80f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.152658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc072f1-76d0-4de9-b8f4-2aa823a7a80f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.152658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc072f1-76d0-4de9-b8f4-2aa823a7a80f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.154028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 556/1124] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:06.159247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.159702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.159801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.176546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:06.177742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:06.244006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 569/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:06.267307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc072f1-76d0-4de9-b8f4-2aa823a7a80f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:06.329075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:06.368819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc072f1-76d0-4de9-b8f4-2aa823a7a80f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:06.401418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:06.402245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.402484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.402764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] PATH_INFO: `/v3/roles/8d5ec9ef32de4f85b4099109af6332eb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.404253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] RBAC: Authorizing `identity:get_role(role_id=8d5ec9ef32de4f85b4099109af6332eb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:06.405642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:06.407013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 557/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:06 2022] GET /identity/v3/roles/8d5ec9ef32de4f85b4099109af6332eb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:06.413303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:06.509933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe38f6-1f7e-4163-8bbf-b06250980392 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:06.522130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:06.543976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:06.544885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.545177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.545457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] PATH_INFO: `/v3/users/bac3e8ade10142759d453c8e8eab3af6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.546643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] RBAC: Authorizing `identity:get_user(user_id=bac3e8ade10142759d453c8e8eab3af6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:06.548077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:06.549725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 570/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:06 2022] GET /identity/v3/users/bac3e8ade10142759d453c8e8eab3af6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:06.555985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:06.652142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3ba0-faa1-4eb5-a74b-dbad7345808d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:06.681404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:06.686897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:06.687537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.687824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.688103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.753456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:06.754901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:06.851477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 558/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:06.858734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:06.961787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08021db-0f86-4e02-a519-64d9dc3c3356 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:06.993915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:06.994766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:06.995051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:06.995325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] PATH_INFO: `/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:06.996515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] RBAC: Authorizing `identity:get_project(project_id=12aa4c7c2e3241f4ae140da14130ef3e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:06.997943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5eba8-91a3-4d38-a209-3a0905f673e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:06.999609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 571/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:06 2022] GET /identity/v3/projects/12aa4c7c2e3241f4ae140da14130ef3e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:07.005690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:07.035927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:07.101810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be592-2eb4-49bf-8373-458f34a2d3fb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:07.134421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:07.135052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:07.135333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:07.135608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:07.136457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] RBAC: Adding query filter params (role.id=8d5ec9ef32de4f85b4099109af6332eb, scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e, user.id=bac3e8ade10142759d453c8e8eab3af6) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:07.136768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:07.138286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c3b90-9a12-4638-a5c1-8ae4d3d84e1b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:07.144389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 559/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:07 2022] GET /identity/v3/role_assignments?user.id=bac3e8ade10142759d453c8e8eab3af6&scope.project.id=12aa4c7c2e3241f4ae140da14130ef3e&role.id=8d5ec9ef32de4f85b4099109af6332eb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:09.203887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd7c8-5774-4bc1-8148-f5051db84e90 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:09.204482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd7c8-5774-4bc1-8148-f5051db84e90 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:09.204482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd7c8-5774-4bc1-8148-f5051db84e90 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:09.205847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 572/1131] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:09.211119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:09.211512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:09.211684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:09.231985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:09.233295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:09.298628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 560/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:09.322827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd7c8-5774-4bc1-8148-f5051db84e90 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:09.372821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:09.422531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd7c8-5774-4bc1-8148-f5051db84e90 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:09.455875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:09.457198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:09.457708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:09.458224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:09.460319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:09.463050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79ca2a-ff3a-4f3f-ac46-c9ed12940484 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:09.466100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 573/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:09.471921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:09.499264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:09.569487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e1ef-e3aa-440a-b175-73cae9e07de4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:09.608700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:09.609365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:09.609662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:09.609943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:09.610655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:09.612099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d37ce-f992-46bc-a25a-aeb2c32336db None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:09.637907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 561/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:35:09 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:11.649292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9cd90-fa2d-4815-9fb8-d6fde6fbec53 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:11.649771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9cd90-fa2d-4815-9fb8-d6fde6fbec53 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:11.649879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9cd90-fa2d-4815-9fb8-d6fde6fbec53 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:11.651204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 574/1135] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:11.656345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:11.656781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:11.656908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:11.673489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:11.674670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:11.740228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 562/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:11.765310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9cd90-fa2d-4815-9fb8-d6fde6fbec53 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:11.864234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9cd90-fa2d-4815-9fb8-d6fde6fbec53 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:11.879969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:11.898119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:11.898903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:11.899188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:11.899466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:11.900663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:11.902094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d628cec-0e07-4bbd-b4d4-730722ce5887 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:11.903688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 575/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:11.909345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:11.919908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:12.022018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d4ed-d8e9-4e34-bd50-b802af1bd28d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:12.055328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:12.055983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:12.056294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:12.056571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:12.057280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:12.058717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55f513-6eff-475a-bf09-12bbc4dc2939 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:12.077910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 563/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:35:11 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:14.098583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea0dac-5093-440b-8a69-2c3452af825a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.099113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea0dac-5093-440b-8a69-2c3452af825a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.099113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea0dac-5093-440b-8a69-2c3452af825a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.100558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 576/1139] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:14.105649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.106068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.106218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.123044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:14.124229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:14.180200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:14.189300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 564/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 13:35:14.214374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea0dac-5093-440b-8a69-2c3452af825a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:14.313688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea0dac-5093-440b-8a69-2c3452af825a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:14.346486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:14.347346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.347636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.347917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.359467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:14.367255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:14.368437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:14.369558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 577/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:14.374349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:14.469068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2873d4-7a67-4951-ba4b-4f5f2797f0d1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:14.501392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:14.502035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.502320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.502595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.503328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:14.503636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:14.505035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:14.513319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 565/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:14.518877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:14.562704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:14.614997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e46f-d1ac-4ca5-9d42-1aadbe5b5071 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:14.649322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:14.650182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.650464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.650742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] PATH_INFO: `/v3/users/491e241cc60843fe8f0dbc884753edba` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.663854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] RBAC: Authorizing `identity:get_user(user_id=491e241cc60843fe8f0dbc884753edba)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:14.665315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:14.666952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 578/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:14 2022] GET /identity/v3/users/491e241cc60843fe8f0dbc884753edba => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:14.672641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:14.727484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:14.769687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b7760-2273-442b-a06e-624d4a5ce43e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:14.802052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:14.802711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:14.802998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:14.803277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:14.868308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:14.869708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:14.922035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:14.965282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 566/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:14.971122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:15.067224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec779eb-7f7b-4e3f-a7e0-24b6c120bacb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:15.069338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:15.101239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:15.102083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:15.102365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:15.102639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] PATH_INFO: `/v3/projects/2708c67ca2684b679f11a8c4726b2b2c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:15.103792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] RBAC: Authorizing `identity:get_project(project_id=2708c67ca2684b679f11a8c4726b2b2c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:15.105246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf900d8-cf21-4118-8f70-e475f264428b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:15.106906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 579/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:14 2022] GET /identity/v3/projects/2708c67ca2684b679f11a8c4726b2b2c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:15.113114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:15.210940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ef03e-18e2-4483-8eff-69c8e927b767 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:15.243700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:15.244372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:15.244662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:15.244939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:15.245764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=2708c67ca2684b679f11a8c4726b2b2c, user.id=491e241cc60843fe8f0dbc884753edba) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:15.246077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:15.247518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae70b6-a75e-4895-85a8-49ed63314e1f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:15.252830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 567/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:15 2022] GET /identity/v3/role_assignments?user.id=491e241cc60843fe8f0dbc884753edba&scope.project.id=2708c67ca2684b679f11a8c4726b2b2c&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:17.213589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c204d-2767-4482-b3fa-2037ea9f0ab9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.214123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c204d-2767-4482-b3fa-2037ea9f0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.214123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c204d-2767-4482-b3fa-2037ea9f0ab9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.215491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 580/1147] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:17.220615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.221037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.221182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.238306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:17.239506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:17.253134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:17.308093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 568/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:17.331051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c204d-2767-4482-b3fa-2037ea9f0ab9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:17.432025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c204d-2767-4482-b3fa-2037ea9f0ab9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:17.465408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:17.466124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.466408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.466682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.477167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:17.484734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:17.485919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:17.486759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 581/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:17.492135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:17.587504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a484e-1c45-41fa-8794-790c62a93f6c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:17.619844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:17.620531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.620819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.621096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.621834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:17.622145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:17.623508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:17.631882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 569/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:17.637606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:17.668677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:17.737326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b44d-6ce5-4a0e-9583-26f60d5cc7fd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:17.770004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:17.770866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.771151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.772019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] PATH_INFO: `/v3/users/491e241cc60843fe8f0dbc884753edba` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.773230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] RBAC: Authorizing `identity:get_user(user_id=491e241cc60843fe8f0dbc884753edba)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:17.774668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:17.776382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 582/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:17 2022] GET /identity/v3/users/491e241cc60843fe8f0dbc884753edba => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:17.782009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:17.796833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:17.880629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532c23-9a16-4f64-80bb-ed85e42b3040 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:17.912942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:17.913787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:17.914073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:17.914352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] PATH_INFO: `/v3/projects/2708c67ca2684b679f11a8c4726b2b2c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:17.915512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] RBAC: Authorizing `identity:get_project(project_id=2708c67ca2684b679f11a8c4726b2b2c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:17.916971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c925df-9c81-4765-9894-e447bcf8b346 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:17.918664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 570/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:17 2022] GET /identity/v3/projects/2708c67ca2684b679f11a8c4726b2b2c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:17.924590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:18.018609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:18.022935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0210-1ee8-40e4-877e-07a232460649 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:18.055939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:18.056859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:18.057148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:18.057428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] PATH_INFO: `/v3/projects/2708c67ca2684b679f11a8c4726b2b2c/users/491e241cc60843fe8f0dbc884753edba/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:18.059386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] RBAC: Authorizing `identity:create_grant(project_id=2708c67ca2684b679f11a8c4726b2b2c, user_id=491e241cc60843fe8f0dbc884753edba, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:18.060865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548dfdb-d22b-4ad1-806c-d3c9844ded25 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:18.074344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 583/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:35:17 2022] PUT /identity/v3/projects/2708c67ca2684b679f11a8c4726b2b2c/users/491e241cc60843fe8f0dbc884753edba/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:35:20.066230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655113be-8943-4fc2-b162-a485a72480a6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.066782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655113be-8943-4fc2-b162-a485a72480a6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.066782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655113be-8943-4fc2-b162-a485a72480a6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.068704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 571/1154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:20.073973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.074369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.074550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.092524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:20.093720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:20.158419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 584/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:20.182132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655113be-8943-4fc2-b162-a485a72480a6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:20.261856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:20.281755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655113be-8943-4fc2-b162-a485a72480a6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:20.314963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:20.315737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.316022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.316376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.326492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:20.334542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:20.335638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:35:20.336602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 572/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:20.341772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:20.425146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:20.437567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231feaca-a671-4fad-a4d3-2b259a8b2c15 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:20.470645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:20.471305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.471591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.471867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.472639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:20.472944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:20.474882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:20.482690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 585/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:20.488342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:20.585486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe2375-4863-420b-a60b-f28a937a5baa None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:20.618211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:20.619063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.619375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.619653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] PATH_INFO: `/v3/users/491e241cc60843fe8f0dbc884753edba` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.620822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] RBAC: Authorizing `identity:get_user(user_id=491e241cc60843fe8f0dbc884753edba)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:20.622270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:20.623874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 573/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:20 2022] GET /identity/v3/users/491e241cc60843fe8f0dbc884753edba => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:20.629711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:20.730451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31c34-9e21-4d6c-84de-bb5824a7ec56 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:20.763305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:20.763944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:20.764258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:20.764545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:20.782206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:20.830722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:20.832284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:20.929385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 586/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:20.935246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:20.946171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:21.031459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4703-85dc-4af3-8238-02a9b9c39437 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:21.063361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:21.064223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:21.064512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:21.064787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] PATH_INFO: `/v3/projects/2708c67ca2684b679f11a8c4726b2b2c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:21.065938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] RBAC: Authorizing `identity:get_project(project_id=2708c67ca2684b679f11a8c4726b2b2c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:21.067365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed28f3-aa2c-4526-abcc-1bbe3fbc418e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:21.069081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 574/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:20 2022] GET /identity/v3/projects/2708c67ca2684b679f11a8c4726b2b2c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:21.075018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:21.123972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:21.173131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3471-93be-44b6-91d2-6525ab3d8eda None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:21.206162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:21.206749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:21.207037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:21.207316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:21.208140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=2708c67ca2684b679f11a8c4726b2b2c, user.id=491e241cc60843fe8f0dbc884753edba) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:21.208485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:21.210415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73308b-4a29-46fc-b810-83ce566f3495 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:21.216113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 587/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:21 2022] GET /identity/v3/role_assignments?user.id=491e241cc60843fe8f0dbc884753edba&scope.project.id=2708c67ca2684b679f11a8c4726b2b2c&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:23.289938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7914-b897-45f3-acab-34d8ef7e675f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:23.290537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7914-b897-45f3-acab-34d8ef7e675f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:23.290537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7914-b897-45f3-acab-34d8ef7e675f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:23.291858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 575/1162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:23.297327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e57-6398-4a51-a661-9f42f488653b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:23.297846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e57-6398-4a51-a661-9f42f488653b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:23.297940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e57-6398-4a51-a661-9f42f488653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:23.314336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-52734e57-6398-4a51-a661-9f42f488653b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:23.315512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-52734e57-6398-4a51-a661-9f42f488653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:23.383339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 588/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:23.405560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7914-b897-45f3-acab-34d8ef7e675f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:23.482549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:23.506126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7914-b897-45f3-acab-34d8ef7e675f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:23.538401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:23.539032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:23.539315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:23.539590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:23.603453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:23.604854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:23.677780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:23.701741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 576/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:23.707721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734e57-6398-4a51-a661-9f42f488653b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:23.751642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:23.804990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734e57-6398-4a51-a661-9f42f488653b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:23.838735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:23.839518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:23.839804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:23.840083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:23.846632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:23.848073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0e15897d-b374-425f-b09b-45331befb733 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:23.862055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:23.863261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:23.864131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 589/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:35:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:23.869609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:23.964858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ba4b-eaf9-4731-ba6d-c9fa69e80f3b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:23.998001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:23.998651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:23.998939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:23.999213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:23.999929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:24.000269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:24.001649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c77ff-47ff-4928-898d-f62a61a87c4f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:24.009320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 577/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 20 13:35:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:26.023883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1f18-e53f-423a-b568-f3f538b16a7e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:26.024438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1f18-e53f-423a-b568-f3f538b16a7e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:26.024528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1f18-e53f-423a-b568-f3f538b16a7e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:26.025832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 590/1167] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:26.030914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e2c0-93c2-430f-aac5-e723ae9dce86 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:26.031362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e2c0-93c2-430f-aac5-e723ae9dce86 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:26.031471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e2c0-93c2-430f-aac5-e723ae9dce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:26.047889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1b15e2c0-93c2-430f-aac5-e723ae9dce86 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:26.049111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1b15e2c0-93c2-430f-aac5-e723ae9dce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:26.085232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:26.118062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 578/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:26.141071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1f18-e53f-423a-b568-f3f538b16a7e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:26.238994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1f18-e53f-423a-b568-f3f538b16a7e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:26.241770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:26.272451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:26.273095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:26.273381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:26.273658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:26.274444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:26.275766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6c670-752c-45f2-b529-71eed46ea945 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:26.289520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 591/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Jul 20 13:35:26 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:28.290819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fe62-8e5d-4cfa-9814-0b7a53033834 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:28.291347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fe62-8e5d-4cfa-9814-0b7a53033834 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:28.291463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6fe62-8e5d-4cfa-9814-0b7a53033834 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:28.292800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 579/1170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:28.298171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:28.298564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:28.298786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:28.316066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:28.317290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:28.386887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 592/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:28.411046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6fe62-8e5d-4cfa-9814-0b7a53033834 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:28.511684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6fe62-8e5d-4cfa-9814-0b7a53033834 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:28.545351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:28.546189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:28.546502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:28.546805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] PATH_INFO: `/v3/domains/b34565d33a614db4be19b29fc939b50b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:28.557822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b34565d33a614db4be19b29fc939b50b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:28.559298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79037806-b172-4839-9e06-ec6c47102221 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:28.561181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 580/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 20 13:35:28 2022] GET /identity/v3/domains/b34565d33a614db4be19b29fc939b50b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:28.566835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:28.660416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:28.668441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd9eb-c2e7-4ddf-8f3d-bcecb18a369f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:28.704032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:28.704736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:28.705028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:28.705310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:28.706054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:28.707561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584fc16-07c9-413e-94b1-ad6269559fb9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:28.733311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 593/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:35:28 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:30.781721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d4b5-8717-4888-9f22-d52fc472797f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:30.782294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d4b5-8717-4888-9f22-d52fc472797f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:30.782294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66d4b5-8717-4888-9f22-d52fc472797f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:30.783679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 581/1174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:30.789370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:30.789809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:30.789946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:30.806254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:30.807433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:30.871776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 594/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:30.896610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66d4b5-8717-4888-9f22-d52fc472797f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:30.927587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:30.999099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66d4b5-8717-4888-9f22-d52fc472797f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:31.032706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:31.033558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:31.033848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:31.034131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] PATH_INFO: `/v3/domains/b34565d33a614db4be19b29fc939b50b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:31.035316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b34565d33a614db4be19b29fc939b50b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:31.036875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165dce8-a837-4f25-8771-e3a6213656b0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:31.039322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 582/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 20 13:35:30 2022] GET /identity/v3/domains/b34565d33a614db4be19b29fc939b50b => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:31.045235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:31.118499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:31.142470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca29a-be72-4aea-8ff9-d816d5411b9b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:31.175719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:31.176347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:31.176638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:31.176916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:31.177614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:31.179047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c8f7-b9d2-4946-bb3f-1c695ac4e5ca None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:31.197901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 595/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:35:31 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:35:33.253111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c80b2-7ebd-481f-8d22-67b3479383d2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.253676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c80b2-7ebd-481f-8d22-67b3479383d2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.253676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c80b2-7ebd-481f-8d22-67b3479383d2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:33.255576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 583/1178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:33.260855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.261264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.261428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:33.278517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:33.279706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:33.345430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 596/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:33.369199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c80b2-7ebd-481f-8d22-67b3479383d2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:33.465300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:33.470285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c80b2-7ebd-481f-8d22-67b3479383d2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:33.503412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:33.504131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.504449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.504729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:33.515354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:33.523585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:33.524776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:35:33.525758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 584/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:33.530759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:33.590638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:33.629518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94411152-4567-41b6-95f7-6ce56be44e6b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:33.664767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:33.665425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.665706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.665979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:33.666713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:33.667016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:33.668404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:33.676121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 597/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:33.682630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:33.780748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51068-997c-4209-bb32-6125573ee215 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:33.814291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:33.815155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.815444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.815718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] PATH_INFO: `/v3/users/aa1f37e32bca43ea9f72abee16d22f66` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:33.830171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] RBAC: Authorizing `identity:get_user(user_id=aa1f37e32bca43ea9f72abee16d22f66)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:33.831617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:33.833824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 585/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:33 2022] GET /identity/v3/users/aa1f37e32bca43ea9f72abee16d22f66 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:33.839578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:33.935405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa585d-72f4-4d30-b3ce-e11b57da026e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:33.957472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:33.968797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:33.969431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:33.969715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:33.969989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:34.036581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:34.037969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:34.146568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 598/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:34.152441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:34.170004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:34.249103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c0e3-d16d-4a37-8974-a368a1eb54f0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:34.282491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:34.283334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:34.283623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:34.283907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] PATH_INFO: `/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:34.285115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] RBAC: Authorizing `identity:get_project(project_id=ae70df4d12e54ac2aa8dea79b6acee6c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:34.286629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0172a9-351b-400b-8bcd-b6dc4b4e5e50 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:34.288283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 586/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:34 2022] GET /identity/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:34.294261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:34.318774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:34.391636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc82e9-41a9-4370-a5f8-fbe4e01468d9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:34.424970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:34.425621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:34.425909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:34.426189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:34.427506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=ae70df4d12e54ac2aa8dea79b6acee6c, user.id=aa1f37e32bca43ea9f72abee16d22f66) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:34.427820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:34.429633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70b489-f3d4-46b3-bbf5-ac059df912cd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:34.435280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 599/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:34 2022] GET /identity/v3/role_assignments?user.id=aa1f37e32bca43ea9f72abee16d22f66&scope.project.id=ae70df4d12e54ac2aa8dea79b6acee6c&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:36.426012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba524e-64cf-4bb3-9fdf-66e25c672b9e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:36.426545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba524e-64cf-4bb3-9fdf-66e25c672b9e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:36.426656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba524e-64cf-4bb3-9fdf-66e25c672b9e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:36.427945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 587/1186] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:36.433307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:36.433720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:36.433870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:36.451574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:36.452773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:36.516796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 600/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:36.539712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba524e-64cf-4bb3-9fdf-66e25c672b9e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:36.622850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:36.641799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba524e-64cf-4bb3-9fdf-66e25c672b9e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:36.675057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:36.675860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:36.676230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:36.676448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:36.686702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:36.694887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:36.695937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:35:36.697125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 588/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:36.702352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:36.720005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:36.797114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd0190-8c31-4997-9dfb-ab657866ce0f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:36.832034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:36.832742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:36.833530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:36.833804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:36.834540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:36.834842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:36.836214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:36.844147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 601/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:36.850575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:36.946742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d37d-cd3b-428e-8bb8-47c81dbea4d4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:36.979872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:36.980749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:36.981036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:36.981314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] PATH_INFO: `/v3/users/aa1f37e32bca43ea9f72abee16d22f66` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:36.982484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] RBAC: Authorizing `identity:get_user(user_id=aa1f37e32bca43ea9f72abee16d22f66)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:36.983915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:36.985567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 589/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:36 2022] GET /identity/v3/users/aa1f37e32bca43ea9f72abee16d22f66 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:35:36.991525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:37.069444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:37.088798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599d7b-b8c2-4856-9bcc-df0d704de458 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:37.120005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:37.120872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:37.121156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:37.121432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] PATH_INFO: `/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:37.122577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] RBAC: Authorizing `identity:get_project(project_id=ae70df4d12e54ac2aa8dea79b6acee6c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:37.124001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bca72-d2e3-42c9-95a1-c36da8ee9d26 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:37.125679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 602/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:36 2022] GET /identity/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:37.132024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:37.147911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:37.229471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5bd3-aa0f-4fdf-b9fa-12a75d4a0f54 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:37.261613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:37.262480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:37.262766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:37.263043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] PATH_INFO: `/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c/users/aa1f37e32bca43ea9f72abee16d22f66/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:37.265005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae70df4d12e54ac2aa8dea79b6acee6c, user_id=aa1f37e32bca43ea9f72abee16d22f66, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:37.266444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d54d-874c-49ba-ac44-147090d2a076 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:37.279645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 590/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:35:37 2022] PUT /identity/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c/users/aa1f37e32bca43ea9f72abee16d22f66/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:35:39.305974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38e47-a1d0-4db0-8697-8c3377c3faa5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:39.306614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38e47-a1d0-4db0-8697-8c3377c3faa5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:39.306614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38e47-a1d0-4db0-8697-8c3377c3faa5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:39.307908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 603/1193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:35:39.313311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:39.313700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:39.313871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:39.331138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:35:39.332342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:35:39.395842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 591/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:35:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:35:39.419752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38e47-a1d0-4db0-8697-8c3377c3faa5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:39.518978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38e47-a1d0-4db0-8697-8c3377c3faa5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:39.551680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:39.552483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:39.552775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:39.553057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:39.563480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:35:39.571546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:35:39.572647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:35:39.573668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 604/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:35:39.579075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:39.581285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:39.678508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3d82e-7a4e-4805-a082-881d3632c475 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:39.712798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:39.713458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:39.713749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:39.714034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:39.714784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:39.715096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:39.716499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:39.724346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 592/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:39.730264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:39.741476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:39.829547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c4e6-77e3-4448-bda8-df045d1777b2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:39.863220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:39.864157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:39.864475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:39.864756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] PATH_INFO: `/v3/users/aa1f37e32bca43ea9f72abee16d22f66` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:39.865944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] RBAC: Authorizing `identity:get_user(user_id=aa1f37e32bca43ea9f72abee16d22f66)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:39.867383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:39.869050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 605/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 20 13:35:39 2022] GET /identity/v3/users/aa1f37e32bca43ea9f72abee16d22f66 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:39.874926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:39.935878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:39.972720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fbd5-0151-441b-b9d3-f41626cbe9d3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:40.005756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:40.006383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:40.006668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:40.006944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:40.071955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:40.073817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:40.131614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:40.169375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 593/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:35:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:35:40.175416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:40.250190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:40.273342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82dbd3-ecd6-41f4-b0b2-bbff3badbe93 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:40.306006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:40.306853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:40.307131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:40.307400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] PATH_INFO: `/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:40.308579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] RBAC: Authorizing `identity:get_project(project_id=ae70df4d12e54ac2aa8dea79b6acee6c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:40.309998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0757-e46d-452f-ac4d-70b79345ae7a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:40.311649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 606/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 20 13:35:40 2022] GET /identity/v3/projects/ae70df4d12e54ac2aa8dea79b6acee6c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:40.318278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:35:40.415050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaca98d-004c-4052-a9c5-83155afe8163 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:35:40.449015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:35:40.449655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:35:40.449947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:35:40.450484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:35:40.451309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=ae70df4d12e54ac2aa8dea79b6acee6c, user.id=aa1f37e32bca43ea9f72abee16d22f66) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:35:40.451624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:35:40.453089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc03e-3afa-4c85-8a22-ce5ac675cfed None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:35:40.458759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 594/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:35:40 2022] GET /identity/v3/role_assignments?user.id=aa1f37e32bca43ea9f72abee16d22f66&scope.project.id=ae70df4d12e54ac2aa8dea79b6acee6c&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:35:50.302075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=28 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:35:50.456954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:35.324056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd564f0-cdde-4848-909a-7d827882a232 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:35.324981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd564f0-cdde-4848-909a-7d827882a232 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:35.324981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd564f0-cdde-4848-909a-7d827882a232 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:35.326370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 607/1201] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:35.332172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:35.332666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:35.332753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:35.351838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:35.353134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:35.445748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 595/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:35.471970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd564f0-cdde-4848-909a-7d827882a232 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:35.584728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd564f0-cdde-4848-909a-7d827882a232 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:35.626997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:35.628402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:35.628734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:35.629014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:35.642549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:35.644111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:35.666739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:35.667838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:35.673330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:35.673330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:35.673330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:35.673330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:35.673330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 608/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:35.674909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:35.805822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715fca8-23dd-4369-a60e-74eadd0ac5a1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:35.847518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:35.859798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:35.860522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:35.860809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:35.861087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:35.862407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:35.862736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:35.864134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf186d0-f19a-4f13-9d79-5a971c41a8a5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:35.876933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 596/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:35.883701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:35.953242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:36.012161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba89b-8051-4c6e-914c-97168425d17f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:36.053159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:36.054192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:36.054461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:36.054736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:36.055434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:36.056921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6d89-4230-49dd-886b-ed2006eafa89 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:36.087167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 609/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 20 13:36:35 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:36:38.575982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c52d7-c4d2-4e2a-9d28-49caf92ee34b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:38.576554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c52d7-c4d2-4e2a-9d28-49caf92ee34b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:38.576554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c52d7-c4d2-4e2a-9d28-49caf92ee34b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:38.578091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 597/1206] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:38.584776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:38.585213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:38.585375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:38.604311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:38.605814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:38.682234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 610/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:38.706734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c52d7-c4d2-4e2a-9d28-49caf92ee34b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:38.821952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c52d7-c4d2-4e2a-9d28-49caf92ee34b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:38.866113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:38.866113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:38.866578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:38.866848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:38.879553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:36:38.887406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:38.888434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:38.894368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 598/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:36:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:38.895100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:38.948273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:39.014770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51615-e548-4d26-bee9-260d94c3ee7f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:39.057908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:39.058580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:39.058880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:39.059133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:39.059904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:39.060227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:39.061567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:39.076998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 611/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:36:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:39.078968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:39.137034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:39.192251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58552b-461a-4bf9-90a4-0a57fff933a7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:39.229105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:39.229999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:39.230286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:39.230564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:39.242864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:39.244839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:39.266520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:39.268255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:39.273961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:39.273961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:39.273961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:39.273961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:39.273961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 599/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:39.275930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:39.399033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:39.402222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9dd1-d1e7-4b50-9c11-98c00edef441 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:39.445333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:39.446213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:39.446566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:39.446853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:39.447661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:39.448073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:39.450022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:39.465367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 612/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:39.472606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:39.600220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3231-ff92-49fb-80e2-5e557e7fc014 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:39.602336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:39.648356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:39.649465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:39.649663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:39.649915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:39.662848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:39.664663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:36:39.683742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:39.684902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:39.686056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 600/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:39.692898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:39.828666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f79e1-8964-448b-80db-ab7d581fbba8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:39.875825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:39.876534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:39.876826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:39.877581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:39.878412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:39.878720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:39.880223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:39.904708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 613/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:36:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:39.905966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:40.029714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234feb-ebd4-477e-ba4c-0bad7c9264fc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:40.077672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:40.078692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:40.079158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:40.079604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:40.120854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:40.168349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:40.169940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:40.287429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 601/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:36:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:36:40.293322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:40.316166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:40.432428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a623d0-20bd-4725-9935-6c81c088dad3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:40.472961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:40.473848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:40.474143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:40.474429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:40.491700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:40.493516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:40.514304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:40.516332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:40.518413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:40.518413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:40.518413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:40.518413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:40.518413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 614/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:40.521432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:40.599849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:40.645347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefbf4-e91e-483b-9f93-cf3c0377537b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:40.685925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:40.686513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:40.686802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:40.687084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:40.687820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:40.688137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:40.689579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:40.702397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 602/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:40.708151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:40.801137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:40.843300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa55e3-8b49-445a-8019-5cae0dd9c835 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:40.881614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:40.882415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:40.882698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:40.882999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:40.890115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:40.891621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:36:40.910135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:40.911290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:40.912254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 615/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:40.917440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:41.028081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c5af-a3e8-4eca-ad14-9a1a3bc4d31e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:41.052766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:41.069982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:41.071001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:41.071430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:41.071809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:41.072848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:41.073264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:41.075059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d18eaa-eb5f-49e0-bd65-d3e06a36831c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:41.087902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 603/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:41.094533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:41.210472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a4f6-819b-4053-b540-b6d793e2ae40 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:41.242318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:41.250796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:41.251452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:41.251772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:41.252547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:41.253381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=1777a8169cdc435481082952d2fbefe8) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:41.253691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:41.255249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7976eb-de2f-4327-b95c-e37824740b0a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:41.263595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 616/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:36:41 2022] GET /identity/v3/role_assignments?user.id=1777a8169cdc435481082952d2fbefe8&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:43.484331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf75e-96e1-49d9-8098-19fd39c5af10 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:43.484922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf75e-96e1-49d9-8098-19fd39c5af10 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:43.484922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf75e-96e1-49d9-8098-19fd39c5af10 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:43.486426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 604/1220] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:43.492076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:43.492622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:43.492816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:43.512068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:43.513432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:43.589192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 617/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:43.616743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf75e-96e1-49d9-8098-19fd39c5af10 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:43.727039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf75e-96e1-49d9-8098-19fd39c5af10 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:43.760718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b937-25b9-41fd-baad-865350306300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:43.761426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b937-25b9-41fd-baad-865350306300 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:43.761714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b937-25b9-41fd-baad-865350306300 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:43.761991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b937-25b9-41fd-baad-865350306300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:43.773145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b937-25b9-41fd-baad-865350306300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-9607b937-25b9-41fd-baad-865350306300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:36:43.781329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:43.782879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:43.783818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 605/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:43.789611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:43.913856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17fe94-60b1-4e7d-9b90-99fedde56500 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:43.938290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:43.950185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:43.950859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:43.951146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:43.951426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:43.952179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:43.952591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:43.953976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:43.962831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 618/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:43.968687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b937-25b9-41fd-baad-865350306300 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:44.027172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:44.091733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b937-25b9-41fd-baad-865350306300 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:44.132083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:44.132921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:44.133304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:44.133467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:44.146654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:44.148304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:44.167183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:44.168927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:44.170030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:44.170030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:44.170030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:44.170030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:44.170030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 606/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:44.174897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:44.288391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ca10-7d81-4fc0-9662-89f79ee4f54e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:44.326120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:44.326878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:44.327236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:44.327637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:44.328466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:44.328850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:44.330953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:44.344638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 619/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:36:44.350489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:44.454073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:44.462535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87b62-d9ed-4bf2-9a0d-739510401316 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:44.499254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:44.500045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:44.500420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:44.500709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:44.510424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:44.512102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:36:44.529735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:44.530862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:44.531988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 607/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:44.537263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:44.594194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:44.661577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e76c-f78b-46e6-9a6c-14828ad2663c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:44.701237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:44.701998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:44.702324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:44.702693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:44.703643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:44.703976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:44.705689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:44.725486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 620/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:44.732310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:44.846191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557e75-904d-43de-b5f0-18c0aff48613 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:44.886953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:44.887778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:44.888097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:44.888498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:44.900291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:44.901860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:44.921985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:44.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:44.924967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:44.924967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:44.924967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:44.924967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:44.924967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 608/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:44.929663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:45.046313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785679c-3a59-468a-a4cc-5f41cdaf9d2b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:45.049280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:45.087249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:45.088055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:45.088415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:45.088783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:45.089580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:45.089921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:45.091433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:45.103883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 621/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:45.109838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:45.121583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:45.232787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517b329-8fc0-4a19-ad18-86c9adef0f69 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:45.273685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:45.274547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:45.274841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:45.275124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:45.286526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:45.288018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:36:45.304702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:45.305987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:45.307125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 609/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:45.312221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:45.431332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f018c9-2320-413e-9ae7-e977a7414399 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:45.471981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:45.472828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:45.473172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:45.473464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:45.474246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:45.474553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:45.475977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45f3c-7664-49dc-bb62-5096eb9aab8a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:45.488267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 622/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:45.494780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:45.566750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:45.609291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d265c5-71bf-404e-9932-a8fcab7753fa None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:45.650346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:45.651398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:45.651686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:45.651968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/1777a8169cdc435481082952d2fbefe8/roles/d5fd1620be5f40ddadd130a58ec29dfd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:45.668975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=1777a8169cdc435481082952d2fbefe8, role_id=d5fd1620be5f40ddadd130a58ec29dfd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:45.671031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34163568-ffbb-4b7e-bcb2-aa4c54dd81f9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:45.685217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 610/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:36:45 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/1777a8169cdc435481082952d2fbefe8/roles/d5fd1620be5f40ddadd130a58ec29dfd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:36:47.934857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164bb1-4b57-49cb-8a9c-828d3bd443cb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:47.935404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164bb1-4b57-49cb-8a9c-828d3bd443cb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:47.935404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164bb1-4b57-49cb-8a9c-828d3bd443cb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:47.936803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 623/1233] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:47.941939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72757b-2661-410d-a8fe-113615a181af None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:47.942333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72757b-2661-410d-a8fe-113615a181af None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:47.942518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72757b-2661-410d-a8fe-113615a181af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:47.960566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4e72757b-2661-410d-a8fe-113615a181af None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:47.961863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4e72757b-2661-410d-a8fe-113615a181af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:48.034113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 611/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:48.058100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164bb1-4b57-49cb-8a9c-828d3bd443cb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:48.088889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:48.174541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164bb1-4b57-49cb-8a9c-828d3bd443cb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:48.213378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:48.214096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:48.214382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:48.214671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:48.225242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:36:48.232893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:48.234159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:48.235015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 624/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:48.240428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72757b-2661-410d-a8fe-113615a181af None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:48.290443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:48.349442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72757b-2661-410d-a8fe-113615a181af None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:48.394203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:48.394885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:48.395187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:48.395446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:48.396231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:48.396550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:48.397942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:48.408256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 612/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:48.414270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:48.506346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:48.526383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a00409-e894-4a7e-9d65-7f0f7d459955 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:48.562068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:48.562865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:48.563153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:48.563430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:48.575121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:48.576616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:48.596822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:48.597944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:48.599027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:48.599027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:48.599027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:48.599027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:48.599027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 625/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:48.604462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:48.718645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba5be-8521-4b6c-9d33-f2d00e75b930 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:48.729778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:48.758156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:48.758798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:48.759089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:48.759370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:48.760096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:48.760439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:48.761929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:48.779508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 613/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:48.780936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:48.889637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482aba6-8103-4c14-8edf-1533769d452f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:48.935656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:48.936553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:48.936963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:48.937318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:48.940528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:48.946394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:48.948390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:36:48.964209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:48.965417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:48.966740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 626/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:48.971939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:49.083013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddccf-b30f-463a-beec-b64080b67061 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:49.122571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:49.123172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:49.123457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:49.123739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:49.124606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:49.124912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:49.126345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:49.144665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 614/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:49.151086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:49.261794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9657-2726-455f-8249-7b7190d1105d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:49.302368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:49.303032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:49.303306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:49.303580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:49.385619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:49.393564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:49.396382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:49.514397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 627/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:36:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 13:36:49.520279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:49.552652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:49.631094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aae31-bf60-453f-8fa3-ea8afa349d6c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:49.667144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:49.667978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:49.668258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:49.668540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:49.679146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:49.680669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:49.699122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:49.700647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:49.701758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:49.701758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:49.701758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:49.701758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:49.701758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 615/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:49.708780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:49.806515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:49.812664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12612e-adac-4178-9016-faaf581e23dd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:49.850088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:49.850748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:49.851037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:49.851306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:49.852019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:49.852366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:49.853794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:49.865618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 628/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:49.871204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:49.950710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:49.972392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181196a3-c07e-421f-8a12-6c8bde28a8fb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:50.011556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:50.012518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:50.012812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:50.013124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:50.021475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:50.023120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:36:50.038116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:50.039161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:50.040066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 616/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 13:36:50.045888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:50.152393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e296e-89e3-4f4c-93c1-ad6287131f53 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:50.188076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:50.188769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:50.189659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:50.189943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:50.190727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:50.191037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:50.192506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca0b0-c1d5-4d93-93d7-3ef78b54f8d8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:50.206841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 629/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:50.213369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:50.332670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1d8-dc68-430f-b7a3-0d4c0bc9cd14 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:50.373959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:50.374867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:50.375263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:50.375651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:50.376863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] RBAC: Adding query filter params (role.id=d5fd1620be5f40ddadd130a58ec29dfd, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=1777a8169cdc435481082952d2fbefe8) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:50.377426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:50.379320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba589-f816-49f1-919c-cdb52f13f00c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:50.386466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 617/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:36:50 2022] GET /identity/v3/role_assignments?user.id=1777a8169cdc435481082952d2fbefe8&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=d5fd1620be5f40ddadd130a58ec29dfd => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:52.573854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27ee5-3686-4e0d-907a-04191a9511bd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:52.574677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27ee5-3686-4e0d-907a-04191a9511bd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:52.574794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca27ee5-3686-4e0d-907a-04191a9511bd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:52.576289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 630/1247] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:52.585967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:52.586452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:52.586555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:52.591660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:52.604176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:52.605401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:52.687317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 618/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:52.713817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca27ee5-3686-4e0d-907a-04191a9511bd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:52.733724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:52.834952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca27ee5-3686-4e0d-907a-04191a9511bd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:52.872525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:52.874169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:52.874169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:52.874169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:52.886204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:36:52.894580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:52.895625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:52.896543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 631/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:52.902240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.013528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0c4d3-83fb-47dc-b654-f5086b964ea0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.046383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:53.053719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.054430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.054720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.054998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:53.055756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:53.056063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:53.057552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:53.069076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 619/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:53.075784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.167101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:53.194629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca797aa-2c79-40e6-b769-0f42ad080b27 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.232167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.232986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.233270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.233545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:53.246052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:53.247573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:53.265199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:53.266451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:53.267717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:53.267717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:53.267717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:53.267717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:53.267717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 632/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:53.272415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.386191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941889f-30e7-4f22-9c94-13d8eaaeadb4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.424341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.425363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.425868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.426373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:53.428076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:53.428423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:53.429846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:53.442811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 620/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:36:53.448424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.556833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7150b1-6d1f-4264-b8ba-8b7fd753277e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.585100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:53.596479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.597288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.597580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.597862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:53.606022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:53.607604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:36:53.622725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:53.623839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:53.625193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 633/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:53.630257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.697090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:53.752846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb139-9cf4-499a-a65f-91f8594aa947 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.794439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.795247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.795537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.795881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:53.796910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:53.797290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:53.799076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:53.824758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 621/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:36:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:53.826420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:53.947503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7e09c-5c6a-40e5-8f05-2ace19785250 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:53.982795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:53.983447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:53.983738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:53.984018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:54.039699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:54.052118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:54.053606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:54.157704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 634/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:36:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:36:54.163796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:54.280718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3864-9635-4bb6-bf0c-a6f9f4311066 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:54.295352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:54.318848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:54.319656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:54.319983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:54.320294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:54.331599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:54.333200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:54.351771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:54.352900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:54.353818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:54.353818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:54.353818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:54.353818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:54.358207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 622/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:54.359241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:54.463409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:54.475813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42c5d-751a-4230-922e-4f8cc2b9b2f1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:54.515364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:54.516364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:54.516870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:54.517242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:54.518241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:54.518557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:54.520061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:54.533998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 635/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:36:54.539864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:54.648084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0431-8bfa-4c0f-9a88-597183007c88 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:54.684161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:54.685062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:54.685348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:54.685614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:54.692179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:54.693633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:36:54.709020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:54.710412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:36:54.711662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 623/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:54.716671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:54.837559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f755c-554b-4c24-836b-359620bb470d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:54.875064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:54.875742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:54.876028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:54.876408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:54.877230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:54.877544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:54.879036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e69a-608c-421a-9f96-60980d037f3f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:54.892579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 636/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:36:54.899110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:54.927494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:55.019955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2188-8276-4c70-8949-565be29e3640 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:55.056854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:55.057519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:55.057811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:55.058091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:55.058930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=1777a8169cdc435481082952d2fbefe8) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:55.059245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:55.060746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec1d-ed8f-4672-a9e3-597d5cc23913 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:55.066813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 624/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:36:54 2022] GET /identity/v3/role_assignments?user.id=1777a8169cdc435481082952d2fbefe8&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:57.116497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f4dd-276a-40be-84ba-78af610530fb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.117028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f4dd-276a-40be-84ba-78af610530fb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.117146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f4dd-276a-40be-84ba-78af610530fb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.118420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 637/1261] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:36:57.123535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.124004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.124090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.140860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:36:57.142596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:36:57.207084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 625/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:36:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:36:57.228964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f4dd-276a-40be-84ba-78af610530fb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:57.239710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:57.328560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f4dd-276a-40be-84ba-78af610530fb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:57.365245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:57.366155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.366570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.366827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.378932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:36:57.387750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:57.388894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:57.389938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 638/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:57.396587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:57.416143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:57.509251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a626-dae2-4bb1-8b28-c593fd615733 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:57.542254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:57.542912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.543199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.543477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.544243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:57.544557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:57.545926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:57.554234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 626/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:57.559940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:57.625617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:57.661212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6d59-1194-4db1-8ae4-332a98513fc1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:57.694963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:57.695749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.696040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.696354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.707284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:57.708772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:57.726810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:57.727880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:57.729022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:57.729022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:57.729022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:57.729022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:57.729022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 639/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:57.734324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:57.822163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:57.841809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e429ab-dd09-4fb0-9c29-ac77d94e85ce None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:57.875851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:57.876974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:57.877260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:57.877537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:57.878256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:57.878567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:57.879943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:57.891435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 627/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:57.897884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:57.994302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e292a-3df8-43b7-8ae9-d17d9cdc3eea None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.013498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:58.027384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.028169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.028488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.028770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.036007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.037469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:36:58.051927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:58.053026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:58.054049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 640/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:58.058856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.158028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b213ac-d518-491d-bbc3-98c8d406c574 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.197599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.198270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.198557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.198839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.199941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:58.200291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.201732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.210880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:58.220924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 628/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:36:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:58.226594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.331134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fe0-406e-4550-8f6c-ae7795fa10af None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.366689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.367522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.367921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.368282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.383731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.385415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:36:58.403892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:58.405000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:58.406418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:36:58.406418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:36:58.406418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:36:58.406418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:58.406418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 641/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:58.411833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.507810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028ade-a350-4957-a106-f431eb23e1b2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.542573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.543242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.543532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.543815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.544583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:58.544898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.546306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.557985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 629/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:58.564327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.596845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:58.665343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9931e3-1d84-425e-a91e-811af6aa5e1e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.699848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.700660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.700953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.701233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.708421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.709864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:36:58.723845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:36:58.724873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:36:58.725746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 642/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:36:58.730925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.788272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:58.837467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c39c-c9a0-46a9-9abb-ca6ad3c4e5c6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:58.870175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:58.870824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:58.871115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:58.871394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:58.872210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:36:58.872541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:58.873973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad292567-568a-4c69-b09d-eb7b802ef9ad None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:58.886294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 630/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:36:58.892476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:36:58.980789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:36:58.990354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c1bb-1d76-4bea-a1c8-76f833ccff0d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:36:59.025837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:36:59.026721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:36:59.027010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:36:59.027290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] PATH_INFO: `/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/1777a8169cdc435481082952d2fbefe8/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:36:59.029252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] RBAC: Authorizing `identity:create_grant(project_id=08bfa60b52d248c78ab1cfc578a49c24, user_id=1777a8169cdc435481082952d2fbefe8, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:36:59.030695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b385a-4f5d-4d0c-b6b2-626b794ac9ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:36:59.043357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 643/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 20 13:36:58 2022] PUT /identity/v3/projects/08bfa60b52d248c78ab1cfc578a49c24/users/1777a8169cdc435481082952d2fbefe8/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:37:01.054230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242be6-d2a8-4896-b0d1-7d408386a62b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.054769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242be6-d2a8-4896-b0d1-7d408386a62b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.054769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242be6-d2a8-4896-b0d1-7d408386a62b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.056157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 631/1274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:37:01.061297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.061742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.061939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.080033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:37:01.081308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:37:01.149576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 644/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:37:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:37:01.172410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88242be6-d2a8-4896-b0d1-7d408386a62b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.275041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88242be6-d2a8-4896-b0d1-7d408386a62b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:01.293695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:01.312079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:01.312846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.313134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.313415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.323730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 13:37:01.332207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:01.333165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:01.334000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 632/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:01.339389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.425687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:01.446124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96aa7-a0a3-4d5d-af26-b3bf1fca9618 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:01.480813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:01.481482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.481770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.482043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.482788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:01.483275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:01.484777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:01.493558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 645/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:01.499275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.597169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adafdf-401d-4587-8175-b3dc9f389f6e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:01.630202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:01.630987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.631275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.631553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.642602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:01.644060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:37:01.660767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:01.661801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:01.662759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:37:01.662759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:37:01.662759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:37:01.662759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:01.662759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 633/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:01.667752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.764781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc25f06-72fb-4a5e-b886-58da3e254504 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:01.797076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:01.798230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.798515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.798792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.799508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:01.799818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:01.801219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:01.813163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 646/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:01.819340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.849641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:01.918308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20241e21-4f3d-4125-8710-4424c72f3d99 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:01.951910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:01.952734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:01.953017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:01.953289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:01.960532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:01.961970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 13:37:01.975719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:01.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:01.978493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 634/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:01.982739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:01.987210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:02.080295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dfcb2-3bc5-4846-b0c0-2761428536c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:02.113018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:02.113618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:02.113905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:02.114184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:02.115007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:02.115319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:02.116777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:02.133245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 647/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 20 13:37:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:02.138805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:02.238188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:02.248002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab0d9-a813-4530-a28b-4ec0214e076a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:02.281015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:02.281650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:02.281936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:02.282242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:02.347262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:02.349200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:02.440154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:02.450809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 635/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 20 13:37:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 13:37:02.457362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:02.522986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:02.560485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc792f-d7eb-4b3d-bca8-d593160d11b0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:02.593126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:02.593908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:02.594190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:02.594460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:02.604058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:02.605541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 13:37:02.622896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:02.624047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:02.625315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 13:37:02.625315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 13:37:02.625315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 13:37:02.625315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:37:02.625315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 648/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:02.630431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:02.726401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9eaa-5c18-4a7c-b977-4b6616367d5f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:02.759432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:02.760091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:02.760408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:02.760689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:02.761405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:02.761716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:02.763079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:02.773943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 636/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 20 13:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:02.779500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:02.875150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fd5b8-663c-4444-a59c-c2af19bac611 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:02.889253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:02.909331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:02.910110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:02.910394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:02.910669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:02.917091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:02.918531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 13:37:02.932543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:02.933594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 13:37:02.934550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 649/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 20 13:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:02.939568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:02.988984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:03.037345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63223-0bf9-4741-b91c-c9a10d5e6901 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:03.070354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:03.071009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:03.071297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:03.071579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:03.072389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:03.072703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:03.074409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5ac2-8b5f-4ff6-b406-bda993ebc4c7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:03.086377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 637/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 20 13:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:03.092445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:03.191156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535948-b1d9-41c0-ba28-f102347b1038 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:03.223978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:03.224641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:03.224927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:03.225203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:03.226020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] RBAC: Adding query filter params (role.id=5eff81fcaccb431393e18ad18a54e1c4, scope.project.id=08bfa60b52d248c78ab1cfc578a49c24, user.id=1777a8169cdc435481082952d2fbefe8) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:03.226331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:03.227756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cf2da-542a-4568-a965-fc357761d13a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:03.233528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 650/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 20 13:37:03 2022] GET /identity/v3/role_assignments?user.id=1777a8169cdc435481082952d2fbefe8&scope.project.id=08bfa60b52d248c78ab1cfc578a49c24&role.id=5eff81fcaccb431393e18ad18a54e1c4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:05.290795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c502-22a7-4c45-ac18-12a454fd64dd None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:05.291344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c502-22a7-4c45-ac18-12a454fd64dd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:05.291449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3c502-22a7-4c45-ac18-12a454fd64dd None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:05.293028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 638/1288] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:37:05.298790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:05.299226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:05.299356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:05.315792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:37:05.317021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:37:05.346173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:05.396883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 651/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:37:05.431240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c502-22a7-4c45-ac18-12a454fd64dd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:05.533541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3c502-22a7-4c45-ac18-12a454fd64dd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:05.544162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:05.571437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:05.572248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:05.572538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:05.572815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:05.573461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:05.575109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:05.587480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:05.588702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:05.589645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 639/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:37:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:05.595424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:05.690013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634fc6-ba70-4c97-88e7-f7ce41eefbd4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:05.723583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:05.724256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:05.724544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:05.724821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:05.725518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:05.725824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:05.727306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5b41-abfe-4a1e-88da-10cc1da8f65f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:05.731894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 652/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 20 13:37:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:05.737707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:05.834781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe312c1-1568-4697-a9c2-63d30a0054e5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:05.867412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:05.868051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:05.868368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:05.868647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:05.869341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:05.869649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:05.871011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac4a09-2059-41f4-82ef-2d40cc563826 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:05.875451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 640/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 20 13:37:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:07.863930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3a73-0c12-41ba-96fb-cbeeaf3ecdc8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:07.864504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3a73-0c12-41ba-96fb-cbeeaf3ecdc8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:07.864504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3a73-0c12-41ba-96fb-cbeeaf3ecdc8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:07.865868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 653/1293] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:37:07.870956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf428-6ed7-41fa-95bd-7c0af9f87fe5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:07.871375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf428-6ed7-41fa-95bd-7c0af9f87fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:07.871527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf428-6ed7-41fa-95bd-7c0af9f87fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:07.887887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-48fdf428-6ed7-41fa-95bd-7c0af9f87fe5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:37:07.889048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-48fdf428-6ed7-41fa-95bd-7c0af9f87fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:37:07.929405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:07.967634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 641/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:37:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:37:07.992862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c3a73-0c12-41ba-96fb-cbeeaf3ecdc8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:08.023358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:08.091425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c3a73-0c12-41ba-96fb-cbeeaf3ecdc8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:08.123769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:08.124438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:08.124724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:08.125001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:08.125751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:08.127107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18861f-84fb-432a-9f2c-6a2a3b921b62 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:08.139281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 654/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 20 13:37:07 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:37:10.229777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c633dc-6636-4ab6-aacc-1e5889d87b16 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.230372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c633dc-6636-4ab6-aacc-1e5889d87b16 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.230372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c633dc-6636-4ab6-aacc-1e5889d87b16 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.231690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 642/1296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:37:10.237440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.237876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.238075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.255831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:37:10.257057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:37:10.329663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 655/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:37:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:37:10.352797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c633dc-6636-4ab6-aacc-1e5889d87b16 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:10.466323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c633dc-6636-4ab6-aacc-1e5889d87b16 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:10.500578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:10.501309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.501595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.501873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.502526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:10.503974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:10.516077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:10.517239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:10.518110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 643/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:37:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:10.523355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:10.542497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:10.627167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb051-ccd5-41da-8a55-33faf6f262ce None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:10.660557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:10.661216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.661499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.661775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.662481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:10.662779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:10.664140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:10.669169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 656/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 20 13:37:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:10.675659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:10.706443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:10.773699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284578c-7db7-4658-99e1-b1b42ddfed33 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:10.806644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:10.807289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.807575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.807853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.808665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] RBAC: Adding query filter params (interface=public, service_id=0eecc9f9f6214adb87b852841c0cc9e9, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:10.808982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:10.810347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093dcf-5ac6-457d-acfe-5001b85324e7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:10.815223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 644/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 20 13:37:10 2022] GET /identity/v3/endpoints?service_id=0eecc9f9f6214adb87b852841c0cc9e9&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:10.821130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:10.901127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:10.919382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a4011-c877-4614-8afe-6dfb6ef8a635 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:10.952022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:10.952703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:10.952992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:10.953272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:10.954444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:10.955804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424fac9-72e0-46b6-aae1-1f6d459226e6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:10.962495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 657/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 20 13:37:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:37:12.938676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e4de-f074-4b95-9103-5d047ce3bbcf None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:12.939235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e4de-f074-4b95-9103-5d047ce3bbcf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:12.939235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e4de-f074-4b95-9103-5d047ce3bbcf None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:12.940636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 645/1302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:37:12.945604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:12.946005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:12.946181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:12.963703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:37:12.964931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:37:13.031170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 658/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:37:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 13:37:13.054200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e4de-f074-4b95-9103-5d047ce3bbcf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:13.149948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:13.157498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e4de-f074-4b95-9103-5d047ce3bbcf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:13.202504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:13.203273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:13.203636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:13.203922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:13.204609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:13.206065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 13:37:13.219081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 13:37:13.220360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 20 13:37:13.221440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 646/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 20 13:37:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 13:37:13.226782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:13.305286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:13.330291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9ed4-2342-40ab-b38d-f71cc2d10eb5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:13.368430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:13.369184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:13.369513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:13.369817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:13.370567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:37:13.370876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:13.372424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291865f-e5f9-4d2a-bf3b-8693e528994a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:13.378571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 659/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 20 13:37:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:37:13.384368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:37:13.486872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f35b-c3ae-477a-ab11-c548073763b7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:37:13.520383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:37:13.521045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:37:13.521359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:37:13.521663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:37:13.522460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:37:13.523938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c99a14-fd2c-4fec-a478-fd85efb79961 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:37:13.542353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 647/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 20 13:37:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:37:23.374610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:37:23.538451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:16.134334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4b52-31f1-4cb2-9dfd-9da3b354db8c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:16.134886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4b52-31f1-4cb2-9dfd-9da3b354db8c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:16.134886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4b52-31f1-4cb2-9dfd-9da3b354db8c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:16.136380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 660/1307] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:16.142341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87677-afd7-40df-9b67-fdbd9e176291 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:16.143201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87677-afd7-40df-9b67-fdbd9e176291 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:16.143694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87677-afd7-40df-9b67-fdbd9e176291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:16.220568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-69d87677-afd7-40df-9b67-fdbd9e176291 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:16.222217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-69d87677-afd7-40df-9b67-fdbd9e176291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:16.509432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 648/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:16.550485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:16.550952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:16.551355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:16.553214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 661/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Jul 20 13:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:16.559670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609ef0b-07af-4f1d-b88b-18a309f9903b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:16.560114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609ef0b-07af-4f1d-b88b-18a309f9903b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:16.560522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609ef0b-07af-4f1d-b88b-18a309f9903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:16.649907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4609ef0b-07af-4f1d-b88b-18a309f9903b None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:16.651481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4609ef0b-07af-4f1d-b88b-18a309f9903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:16.675095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:16.748472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 649/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Jul 20 13:38:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:16.758311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:16.760786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:16.913134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad8692-ea53-4ea8-abab-9efd5ee4b7fc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:17.006628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:17.007401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:17.007689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:17.007971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:17.009637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:17.070616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:17.129885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:17.131521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb7c6e-ad22-415d-9756-b27f2ef70c36 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:17.152108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 662/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:19.501714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:19.502279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:19.502279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:19.503656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 650/1312] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:19.509037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324898-526b-4fe1-b0d7-b9335c02bf7a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:19.509713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324898-526b-4fe1-b0d7-b9335c02bf7a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:19.510033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324898-526b-4fe1-b0d7-b9335c02bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:19.594861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a6324898-526b-4fe1-b0d7-b9335c02bf7a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:19.596454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6324898-526b-4fe1-b0d7-b9335c02bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:19.702578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 663/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:19.742986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:19.744698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:19.855423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cde3a-ac5e-404a-96e4-47e3cfa03f86 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:19.925516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:19.928449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:19.929305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:19.929761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:19.930314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:19.932081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:20.043219 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:20.044807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6103b4a-f232-4702-b0d9-2d538851d6f0 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:20.063400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 651/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:22.393438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:22.393973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:22.394099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:22.395377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 664/1315] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:22.400736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde055a-87d8-49ff-b283-feb2b1eb4a09 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:22.401137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde055a-87d8-49ff-b283-feb2b1eb4a09 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:22.401335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde055a-87d8-49ff-b283-feb2b1eb4a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:22.466901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-bcde055a-87d8-49ff-b283-feb2b1eb4a09 None None] MFA Rules not processed for user `2cb14195ce0944b5b78a96382ce231ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:22.468110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bcde055a-87d8-49ff-b283-feb2b1eb4a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:22.520836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:22.565718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 652/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:22.605794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:22.607337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:22.617648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:22.710659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7239-cc56-4139-bcc2-06944a278dd8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:22.782658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:22.783299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:22.783590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:22.783871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:22.785546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:22.846718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:22.893440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:22.894885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361fc63-4604-4369-8c1e-2d71419cff30 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:22.912757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 665/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:25.493999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661216f-9541-44c2-8618-def8428380df None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:25.494617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661216f-9541-44c2-8618-def8428380df None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:25.494617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661216f-9541-44c2-8618-def8428380df None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:25.495921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 653/1318] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:25.501173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058717-6183-4de2-ab9c-641d069ea158 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:25.501566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058717-6183-4de2-ab9c-641d069ea158 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:25.501741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058717-6183-4de2-ab9c-641d069ea158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:25.568773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-25058717-6183-4de2-ab9c-641d069ea158 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:25.570028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-25058717-6183-4de2-ab9c-641d069ea158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:25.664979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 666/1319] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:25.703733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661216f-9541-44c2-8618-def8428380df None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:25.705300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3661216f-9541-44c2-8618-def8428380df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:25.805720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661216f-9541-44c2-8618-def8428380df None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:25.877395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:25.878025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:25.878309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:25.878605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:25.880345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:25.887178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:25.987880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:25.989347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba55f9-3e7a-454c-a247-c95e2111553c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:26.007766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 654/1320] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:28.710703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:28.711279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:28.711279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:28.712866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 667/1321] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:28.718478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1130-85ff-4030-b6bf-8542256537df None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:28.718884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1130-85ff-4030-b6bf-8542256537df None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:28.719032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1130-85ff-4030-b6bf-8542256537df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:28.786045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ab6e1130-85ff-4030-b6bf-8542256537df None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:28.787261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ab6e1130-85ff-4030-b6bf-8542256537df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:28.850647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:28.894655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 655/1322] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:28.931769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:28.933397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:28.954424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:29.043331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0837f1c-5e15-497b-b175-113618e6c514 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:29.117975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:29.118631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:29.118919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:29.119204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:29.120892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:29.190936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:29.229451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:29.230819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecb2d5-783a-4a39-b74e-6773ea51a559 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:29.248937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 668/1323] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:31.333772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db494-fe0a-4231-9e23-a9e92b20d73a None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:31.334321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db494-fe0a-4231-9e23-a9e92b20d73a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:31.334321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db494-fe0a-4231-9e23-a9e92b20d73a None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:31.335584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 656/1324] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:31.340877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e144b-20ac-4cd7-b720-bd46707eefe8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:31.341338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e144b-20ac-4cd7-b720-bd46707eefe8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:31.341441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e144b-20ac-4cd7-b720-bd46707eefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:31.409967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e56e144b-20ac-4cd7-b720-bd46707eefe8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:31.411207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e56e144b-20ac-4cd7-b720-bd46707eefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:31.509890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 669/1325] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:31.561667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747daedc-7c71-4a49-8875-b221466a268b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:31.561955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747daedc-7c71-4a49-8875-b221466a268b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:31.562239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747daedc-7c71-4a49-8875-b221466a268b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:31.563625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 657/1326] 10.222.0.17 () {54 vars in 965 bytes} [Wed Jul 20 13:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:31.569620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe9b3-bde1-46cd-8bd8-4d3d030ac99b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:31.569916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe9b3-bde1-46cd-8bd8-4d3d030ac99b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:31.570197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe9b3-bde1-46cd-8bd8-4d3d030ac99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:31.605443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:31.653629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ddcfe9b3-bde1-46cd-8bd8-4d3d030ac99b None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:31.654854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ddcfe9b3-bde1-46cd-8bd8-4d3d030ac99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:31.736387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 670/1327] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Jul 20 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:31.745982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747daedc-7c71-4a49-8875-b221466a268b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:31.747561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-747daedc-7c71-4a49-8875-b221466a268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:31.852730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747daedc-7c71-4a49-8875-b221466a268b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:31.934796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:31.936126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:31.936582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:31.936980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:31.938898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:31.957728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:32.065719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:32.067187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4262d1-f03d-4b8d-ae69-0e1a88b71b4e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:32.086468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 658/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:38:34.366767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:34.367284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:34.367396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:34.368940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 671/1329] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:34.374622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5af845-506f-40f8-ae3e-69aa0a87770e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:34.375036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5af845-506f-40f8-ae3e-69aa0a87770e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:34.375170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5af845-506f-40f8-ae3e-69aa0a87770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:34.438466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2a5af845-506f-40f8-ae3e-69aa0a87770e None None] MFA Rules not processed for user `2cb14195ce0944b5b78a96382ce231ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:34.439663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2a5af845-506f-40f8-ae3e-69aa0a87770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:34.524264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:34.559450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 659/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:34.598044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:34.599597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:34.713531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9add5cf-78d9-4f07-99d7-99dd726bb9ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:34.733437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:34.788631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:34.789214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:34.789498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:34.789775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:34.791419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:34.903692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:34.905211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7c9a6-591d-490a-9527-4e86df8b0bea service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:34.923292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 672/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:37.361402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:37.361979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:37.361979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:37.363333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 660/1332] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:37.368555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163218-275d-4da1-84cf-6bb6247be14f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:37.368953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163218-275d-4da1-84cf-6bb6247be14f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:37.369163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163218-275d-4da1-84cf-6bb6247be14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:37.431790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:37.434618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65163218-275d-4da1-84cf-6bb6247be14f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:37.436478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65163218-275d-4da1-84cf-6bb6247be14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:37.531423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 673/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:37.567177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:37.568748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:37.682450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460944fe-867f-4526-b5e9-3d7d414743fb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:37.758154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:37.758809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:37.759097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:37.759378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:37.761067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:37.789820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:37.870348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:37.871819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e87e2-20b4-4182-a054-21f6eb83c3aa service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:37.890267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 661/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:39.967994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:39.968558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:39.968745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:39.969966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 674/1335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:39.975371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04a58-5521-471b-a8c8-e1ee7c470be4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:39.975840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04a58-5521-471b-a8c8-e1ee7c470be4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:39.975943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f04a58-5521-471b-a8c8-e1ee7c470be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:40.039649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-26f04a58-5521-471b-a8c8-e1ee7c470be4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:40.040868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26f04a58-5521-471b-a8c8-e1ee7c470be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:40.115609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:40.138686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 662/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:40.178659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:40.180212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:40.283678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f04ec-ea4a-48f1-9500-b604d58e4bd8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:40.310876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:40.356834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:40.357488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:40.357984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:40.358283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:40.359921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:40.469870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:40.471345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b4f5-b9c8-47df-9957-d5ca99c84938 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:40.488977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 675/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:42.972799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:42.973363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:42.973363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:42.974783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 663/1338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:42.979828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa173-54d2-4249-89d2-22ffdbc2e035 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:42.980299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa173-54d2-4249-89d2-22ffdbc2e035 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:42.980427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa173-54d2-4249-89d2-22ffdbc2e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:43.045762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c1cfa173-54d2-4249-89d2-22ffdbc2e035 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:43.047018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c1cfa173-54d2-4249-89d2-22ffdbc2e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:43.055674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:43.147023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 676/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:43.184048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:43.186311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:43.287374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74629b4c-c347-4bdb-8eb2-28a4a0464fb5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:43.359482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:43.360378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:43.360576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:43.360846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:43.362484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:43.398364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:43.471987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:43.473493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f152-7c45-4d41-84e9-93eb66811a40 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:43.492560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 664/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:47.551866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:47.552426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:47.552543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:47.553937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 677/1341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:38:47.559345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a303-24d8-4967-9386-ff75da28d06d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:47.560461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a303-24d8-4967-9386-ff75da28d06d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:47.560566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a303-24d8-4967-9386-ff75da28d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:47.626323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-baa4a303-24d8-4967-9386-ff75da28d06d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:47.627468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-baa4a303-24d8-4967-9386-ff75da28d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:47.719100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:47.730978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 665/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:47.770706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:47.772266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:47.877210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32564e36-d04c-40ca-8166-fd7a78f81c51 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:47.916053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:47.955361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:47.956024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:47.956348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:47.956630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:47.958302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:48.076451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:48.077977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd28b-740b-4808-b091-f2278d164bf0 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:48.098683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 678/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:50.766090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:50.766552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:50.766660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:50.768048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 666/1344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:50.773591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30be9-f32b-4996-b5a1-4ce477b9f730 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:50.774130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30be9-f32b-4996-b5a1-4ce477b9f730 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:50.774226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30be9-f32b-4996-b5a1-4ce477b9f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:50.841158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-45d30be9-f32b-4996-b5a1-4ce477b9f730 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:50.844484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45d30be9-f32b-4996-b5a1-4ce477b9f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:50.863378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:50.943104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 679/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:38:50.982756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:50.984443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:51.086764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbed8e-bf0a-4644-a2bf-657ab2ff2906 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:51.160635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:51.161289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:51.161632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:51.161916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:51.163589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:51.208502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:51.276514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:51.277960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ea34e-3aae-42de-90d7-d36378d88e85 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:51.297403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 667/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:38:55.254893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:55.255426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:55.255426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:55.256774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 680/1347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:38:55.262086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863adc-90d7-45cc-82c4-46db16c501bb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:55.263153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863adc-90d7-45cc-82c4-46db16c501bb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:55.263251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863adc-90d7-45cc-82c4-46db16c501bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:55.331904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9c863adc-90d7-45cc-82c4-46db16c501bb None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:38:55.333290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c863adc-90d7-45cc-82c4-46db16c501bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:55.454354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:55.464236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 668/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:38:55.496604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:38:55.498689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:55.609068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9371-38eb-403b-a0e7-697eb382bcdc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:38:55.661231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:38:55.689004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:38:55.689659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:38:55.689942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:38:55.690215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:38:55.691866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:38:55.807402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:38:55.808924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0976c-68d0-44f1-b3a3-26d07b7df0de service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:38:55.828638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 681/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:00.727308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5390-dee7-400e-ac7f-ebcb6d8987fd None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:00.727957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5390-dee7-400e-ac7f-ebcb6d8987fd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:00.728348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5390-dee7-400e-ac7f-ebcb6d8987fd None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:00.730191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 669/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:00.735713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54145c-6a67-4cbd-97ec-0e40b14e3236 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:00.736099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54145c-6a67-4cbd-97ec-0e40b14e3236 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:00.736413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54145c-6a67-4cbd-97ec-0e40b14e3236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:00.881019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2f54145c-6a67-4cbd-97ec-0e40b14e3236 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:00.882267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f54145c-6a67-4cbd-97ec-0e40b14e3236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:00.904161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:01.020993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 682/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:39:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:05.302751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54d80d-d01c-408c-9ef0-6088dcba43e5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:05.303610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54d80d-d01c-408c-9ef0-6088dcba43e5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:05.304046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54d80d-d01c-408c-9ef0-6088dcba43e5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:05.305875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 670/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:05.310746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37c3-c38a-4c9d-b755-5566515beab5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:05.311220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37c3-c38a-4c9d-b755-5566515beab5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:05.311459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37c3-c38a-4c9d-b755-5566515beab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:05.408927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a38b37c3-c38a-4c9d-b755-5566515beab5 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:05.410316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a38b37c3-c38a-4c9d-b755-5566515beab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:05.492059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:05.535886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 683/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:39:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:06.744554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adb6d-6c8b-4475-af42-5e7874b5af0c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:06.745096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adb6d-6c8b-4475-af42-5e7874b5af0c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:06.745096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adb6d-6c8b-4475-af42-5e7874b5af0c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:06.746495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 671/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:06.751387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53b63-6108-4b87-81d9-2a18e113fbd3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:06.751783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53b63-6108-4b87-81d9-2a18e113fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:06.752093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53b63-6108-4b87-81d9-2a18e113fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:06.827779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-93f53b63-6108-4b87-81d9-2a18e113fbd3 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:06.829040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-93f53b63-6108-4b87-81d9-2a18e113fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:06.936541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 684/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:39:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:10.416143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee4b9-3df9-42c6-9647-6dec56090e8b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:10.416824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee4b9-3df9-42c6-9647-6dec56090e8b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:10.416824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee4b9-3df9-42c6-9647-6dec56090e8b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:10.418718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 672/1356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:10.424117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b11301-a1d7-4a13-9e04-846395793058 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:10.424592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b11301-a1d7-4a13-9e04-846395793058 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:10.424719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b11301-a1d7-4a13-9e04-846395793058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:10.469197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:10.504647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e7b11301-a1d7-4a13-9e04-846395793058 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:10.505861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e7b11301-a1d7-4a13-9e04-846395793058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:10.611884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 685/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:10.666701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:10.666892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:10.667186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:10.669065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 673/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 20 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:10.678005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695d209-f2fd-4229-8185-ee69b98f9755 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:10.678337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695d209-f2fd-4229-8185-ee69b98f9755 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:10.678693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695d209-f2fd-4229-8185-ee69b98f9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:10.762127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a695d209-f2fd-4229-8185-ee69b98f9755 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:10.763334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a695d209-f2fd-4229-8185-ee69b98f9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:10.813971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:10.884992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 686/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 20 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:10.892673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:10.894184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:11.041826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631decd6-f401-49f4-955d-14490bf96bf9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:11.123489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:11.166340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:11.167081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:11.167441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:11.167815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:11.169541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:11.270192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:11.271835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f3788-79ca-40b3-baf0-6e2d504f8498 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:11.290306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 674/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:13.591371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:13.591912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:13.591912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:13.593406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 687/1361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:13.598486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddaa17-d85f-4cd6-a43c-d04e121fc697 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:13.598907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddaa17-d85f-4cd6-a43c-d04e121fc697 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:13.599041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddaa17-d85f-4cd6-a43c-d04e121fc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:13.674904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f2ddaa17-d85f-4cd6-a43c-d04e121fc697 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:13.676311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2ddaa17-d85f-4cd6-a43c-d04e121fc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:13.720556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:13.794445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 675/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:13.838850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:13.842666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:14.019240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e78c5-b286-4a9e-bab4-e8cb430cd0e7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:14.033678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:14.149534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:14.150194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:14.150477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:14.150786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:14.153035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:14.242495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:14.244205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704758-f11f-4962-9ca3-a8ed66ff01e6 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:14.262790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 688/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:16.636620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645b69d-d430-47ca-a63f-0885b8ffb60a None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:16.638555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645b69d-d430-47ca-a63f-0885b8ffb60a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:16.639051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645b69d-d430-47ca-a63f-0885b8ffb60a None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:16.640763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 676/1364] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:16.649752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea33ef-00c9-4542-a9fa-3b858eeb49eb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:16.650678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea33ef-00c9-4542-a9fa-3b858eeb49eb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:16.651198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea33ef-00c9-4542-a9fa-3b858eeb49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:16.667889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:16.724868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-90ea33ef-00c9-4542-a9fa-3b858eeb49eb None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:16.726590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-90ea33ef-00c9-4542-a9fa-3b858eeb49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:16.831139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 689/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:16.877294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:16.877715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:16.878135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:16.879635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 677/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 20 13:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:16.885147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3f77-6f93-40d7-b7ac-d449ec6466fb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:16.885444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3f77-6f93-40d7-b7ac-d449ec6466fb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:16.885731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3f77-6f93-40d7-b7ac-d449ec6466fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:16.982048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-930d3f77-6f93-40d7-b7ac-d449ec6466fb None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:16.983279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-930d3f77-6f93-40d7-b7ac-d449ec6466fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:17.025727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:17.117207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 690/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 20 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:17.125222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:17.126976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:17.284820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52549-0a31-4ea2-9810-ac169915583d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:17.311758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:17.417193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:17.418061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:17.418442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:17.418824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:17.420640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:17.516468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:17.518249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a84d14-fdb2-495f-b3a0-1a3f8af73ce8 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:17.537304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 678/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:39:18.496860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede756-a407-41e2-b979-3b4a8ddad1a0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:18.497972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede756-a407-41e2-b979-3b4a8ddad1a0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:18.498944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede756-a407-41e2-b979-3b4a8ddad1a0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:18.501625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 691/1369] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:18.506943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4169a0-a87c-48a9-9c3b-42580fe57729 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:18.507814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4169a0-a87c-48a9-9c3b-42580fe57729 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:18.508434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4169a0-a87c-48a9-9c3b-42580fe57729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:18.551835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:18.597009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cb4169a0-a87c-48a9-9c3b-42580fe57729 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:18.598572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb4169a0-a87c-48a9-9c3b-42580fe57729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:18.724277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 679/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:19.058420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:19.058707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:19.058985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:19.061130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 692/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 20 13:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:39:19.065963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d578e-4739-49d6-bf87-995bcff2e5ec None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:19.065963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d578e-4739-49d6-bf87-995bcff2e5ec None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:19.066442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d578e-4739-49d6-bf87-995bcff2e5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:19.143207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6f4d578e-4739-49d6-bf87-995bcff2e5ec None None] MFA Rules not processed for user `084b1b3181f34a2dacaa31f937f5d953`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:19.144448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6f4d578e-4739-49d6-bf87-995bcff2e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:19.194263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:19.227343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 680/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 20 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:19.234746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:19.236242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:19.347051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96978ce2-bab2-4f54-849d-07e06436d7ab None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:19.393436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:19.431900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:19.432636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:19.433474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:19.433756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:19.435429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:19.565589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:19.567335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d963a-4d13-4255-b9ef-5e671debfdf8 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:19.589276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 693/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:19.653678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:19.654703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:19.655385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:19.658426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 681/1374] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:19.664102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dcc-561f-4529-b2e9-95e86dcce624 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:19.664618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dcc-561f-4529-b2e9-95e86dcce624 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:19.665074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dcc-561f-4529-b2e9-95e86dcce624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:19.763320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2cd48dcc-561f-4529-b2e9-95e86dcce624 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:19.765447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cd48dcc-561f-4529-b2e9-95e86dcce624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:19.798752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:19.909261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 694/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:19.954816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:19.956497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:20.105866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabb8db-fa74-4f51-b402-109be7937675 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:20.156273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:20.219847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:20.220530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:20.220821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:20.221105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:20.222825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:20.317904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:20.319545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d77c-689c-491c-a8c9-5f7e56440c97 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:20.338179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 682/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:22.411105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:22.411605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:22.411699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:22.413091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 695/1377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:22.418446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faea0-5c70-4ab7-866b-917cf53f4336 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:22.418856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faea0-5c70-4ab7-866b-917cf53f4336 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:22.419079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faea0-5c70-4ab7-866b-917cf53f4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:22.485728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-469faea0-5c70-4ab7-866b-917cf53f4336 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:22.487208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-469faea0-5c70-4ab7-866b-917cf53f4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:22.495521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:22.614057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 683/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:22.682142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:22.683756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:22.841028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba094e5-6169-405c-a751-d91b275d6e76 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:22.844843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:22.961384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:22.962046 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:22.962334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:22.962613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:22.964514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:23.091782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:23.093507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e25b36-f044-42f1-82be-51a07141376d service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:23.118552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 696/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:25.232257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:25.232792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:25.232792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:25.234268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 684/1380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:25.239382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c210-0565-4902-970c-bdfa8c4cea2f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:25.239811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c210-0565-4902-970c-bdfa8c4cea2f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:25.239941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c210-0565-4902-970c-bdfa8c4cea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:25.251064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:25.309928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6411c210-0565-4902-970c-bdfa8c4cea2f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:25.311151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6411c210-0565-4902-970c-bdfa8c4cea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:25.419213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 697/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:25.466620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:25.469009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:25.616696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:25.629432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f0b9-3aa1-439d-8651-49d06309bb13 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:25.750655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:25.751307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:25.751593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:25.751873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:25.753585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:25.847286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:25.849011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb17ac-fa6d-4358-86a3-6e32da272d3c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:25.860998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:25.870316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 685/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:27.950547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476832-0093-43c0-89df-62b6900491a5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:27.951100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476832-0093-43c0-89df-62b6900491a5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:27.951313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476832-0093-43c0-89df-62b6900491a5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:27.953229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 698/1383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:27.958746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87b12-3771-4d13-9da4-8da0527a8f75 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:27.959141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87b12-3771-4d13-9da4-8da0527a8f75 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:27.959335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87b12-3771-4d13-9da4-8da0527a8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:28.027505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-63d87b12-3771-4d13-9da4-8da0527a8f75 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:28.028796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-63d87b12-3771-4d13-9da4-8da0527a8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:28.136352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 686/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:28.181464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476832-0093-43c0-89df-62b6900491a5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:28.183042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-57476832-0093-43c0-89df-62b6900491a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:28.269215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:28.334843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476832-0093-43c0-89df-62b6900491a5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:28.464380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:28.465063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:28.465369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:28.465655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:28.467367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:28.517863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:28.559868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:28.561568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205c55-54bd-4248-8c1f-af1c366e2843 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:28.580805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 699/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:30.661769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:30.662477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:30.662477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:30.663752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 687/1386] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:30.669303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707d10-5a9c-46ea-8b02-2f1296beab98 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:30.669793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707d10-5a9c-46ea-8b02-2f1296beab98 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:30.669969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707d10-5a9c-46ea-8b02-2f1296beab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:30.736758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ab707d10-5a9c-46ea-8b02-2f1296beab98 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:30.737977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ab707d10-5a9c-46ea-8b02-2f1296beab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:30.851321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 700/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:30.898076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:30.899702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:30.987063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:31.067905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914973e4-4b6a-4960-acae-59a9522da79c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:31.208821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:31.209929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:31.210292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:31.210662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:31.212994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:31.253558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:31.314162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:31.315784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5764a-b4bc-4092-ae61-5e4d8669fdf0 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:31.334643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 688/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:33.423136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:33.423674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:33.423674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:33.425193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 701/1389] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:33.430540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528127-5709-4c5c-9a86-81e364cd59d1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:33.430944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528127-5709-4c5c-9a86-81e364cd59d1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:33.431107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528127-5709-4c5c-9a86-81e364cd59d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:33.497688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-19528127-5709-4c5c-9a86-81e364cd59d1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:33.499752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-19528127-5709-4c5c-9a86-81e364cd59d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:33.604223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 689/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:33.649733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:33.651860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:33.682280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:33.802133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f0a2-e0b7-48db-aa6e-57172d2d63f1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:33.910588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:33.923777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:33.924466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:33.924759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:33.925042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:33.926762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:34.016424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:34.017967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0384a-c090-4193-a1ce-e51434de67d7 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:34.036374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 702/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:34.699214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb763-45a4-4f47-abd8-ca303b9827bd None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:34.699736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb763-45a4-4f47-abd8-ca303b9827bd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:34.699851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb763-45a4-4f47-abd8-ca303b9827bd None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:34.701198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 690/1392] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:34.707509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee8116-f38e-44ed-b44c-8ef91b399ece None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:34.707949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee8116-f38e-44ed-b44c-8ef91b399ece None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:34.708080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee8116-f38e-44ed-b44c-8ef91b399ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:34.776471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-79ee8116-f38e-44ed-b44c-8ef91b399ece None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:34.777692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-79ee8116-f38e-44ed-b44c-8ef91b399ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:34.837865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:34.876860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 703/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:34.933760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:34.934059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:34.934348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:34.935722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 691/1394] 10.222.0.17 () {54 vars in 966 bytes} [Wed Jul 20 13:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:34.940673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158d24-617b-471e-999e-9d7571c699c6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:34.940997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158d24-617b-471e-999e-9d7571c699c6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:34.941276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158d24-617b-471e-999e-9d7571c699c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:35.014895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-34158d24-617b-471e-999e-9d7571c699c6 None None] MFA Rules not processed for user `fcd9ef87632c49399f3ec6a92ce92709`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:35.016084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34158d24-617b-471e-999e-9d7571c699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:35.093133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 704/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Wed Jul 20 13:39:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:35.101415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:35.102928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:35.117454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:35.212070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132bfbe-0f23-4a44-8ad8-8df937913248 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:35.285639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:35.286300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:35.286590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:35.286870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:35.288564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:35.357058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:35.399110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:35.400591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd42822-a428-4906-bd22-946bfce88bac service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:35.419306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 692/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:36.109049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9f6a-395f-4675-9428-3d293482ad44 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.110337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9f6a-395f-4675-9428-3d293482ad44 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.110789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c9f6a-395f-4675-9428-3d293482ad44 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.117126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 705/1397] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:36.123460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaae8-0d1b-4502-9a1b-5b6ab4014ed5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.123880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaae8-0d1b-4502-9a1b-5b6ab4014ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.124137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaae8-0d1b-4502-9a1b-5b6ab4014ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.134338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.134776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.136327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.196583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-eddcaae8-0d1b-4502-9a1b-5b6ab4014ed5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:36.198376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-eddcaae8-0d1b-4502-9a1b-5b6ab4014ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.206549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:36.207737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.217078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:36.298379 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 706/1398] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:36.299928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 693/1399] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:36.344034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:36.344768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eae87-42df-49ef-af1d-6be998f41af9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.345070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eae87-42df-49ef-af1d-6be998f41af9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.345388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.345506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eae87-42df-49ef-af1d-6be998f41af9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.346845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 694/1400] 10.222.0.17 () {54 vars in 943 bytes} [Wed Jul 20 13:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:39:36.353649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.354045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.354397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.380337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:36.434015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] MFA Rules not processed for user `d544be4d204445aa832e21033ba1a84e`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:36.435245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.458135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9da2-8f60-44d0-96e1-3d95dd83c565 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:36.499285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:36.546721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 695/1401] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Jul 20 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:36.558584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:36.572157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec4a4-5c76-4c4f-99cc-8301516895f0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:36.581597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:36.582254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.582566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.582807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.584635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.650457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:36.686666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:36.687433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:36.687721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:36.688003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:36.688958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:36.690248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:36.690616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd082e-afd1-49f8-a2aa-7174cf0abbf2 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:36.708918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 707/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:36.785881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:36.787573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349aa49-5814-436a-93aa-cec2e11cc6dd service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:36.797593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 696/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:39:38.803804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:38.804362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:38.804480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:38.806054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 708/1404] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:38.812022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec076-6453-469c-9a0b-ca3aa96adca1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:38.812553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec076-6453-469c-9a0b-ca3aa96adca1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:38.812643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec076-6453-469c-9a0b-ca3aa96adca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:38.888750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2bbec076-6453-469c-9a0b-ca3aa96adca1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:38.890272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2bbec076-6453-469c-9a0b-ca3aa96adca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:38.960212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:39.006593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 697/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:39.052374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:39.054214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:39.109151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:39.218595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ca475-c9ff-4e76-b9d9-46c5aff12eeb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:39.347940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:39.348641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:39.348932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:39.349209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:39.354263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:39.358979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:39.494085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:39.496898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8111f28-18e7-4744-af54-050bef0ddf69 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:39.522298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 709/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:39:41.622973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:41.623504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:41.623504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:41.625033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 698/1407] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:41.630128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b223-7ff2-426d-9d1b-7a4b6a714ff4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:41.630607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b223-7ff2-426d-9d1b-7a4b6a714ff4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:41.630735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b223-7ff2-426d-9d1b-7a4b6a714ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:41.707907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c624b223-7ff2-426d-9d1b-7a4b6a714ff4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:41.709194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c624b223-7ff2-426d-9d1b-7a4b6a714ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:41.797345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:41.820844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 710/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:41.866159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:39:41.867898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:42.034983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a26af2-bdbc-496f-a47c-880bfe2a792a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:39:42.080769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:42.159135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:39:42.159786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:42.160109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:42.160529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:42.162243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:42.267835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:39:42.269512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07091a70-5906-4638-8353-75c180a3f69e service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:39:42.289729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 699/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:39:51.818780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:52.287645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=79 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:58.803259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e43c-0234-4300-92e8-9595c96efde3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:58.803802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e43c-0234-4300-92e8-9595c96efde3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:58.803802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e43c-0234-4300-92e8-9595c96efde3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:58.805129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 711/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 20 13:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:39:58.810715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1931a6-d8eb-42ef-b455-b7082daa2eb9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:58.811166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1931a6-d8eb-42ef-b455-b7082daa2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:58.811556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1931a6-d8eb-42ef-b455-b7082daa2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:58.886831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2e1931a6-d8eb-42ef-b455-b7082daa2eb9 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:58.888046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2e1931a6-d8eb-42ef-b455-b7082daa2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:58.992913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 700/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 20 13:39:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:39:59.007615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fbbd-81e6-4dfa-9330-3dc15ed43f21 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:59.007912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fbbd-81e6-4dfa-9330-3dc15ed43f21 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:59.008219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fbbd-81e6-4dfa-9330-3dc15ed43f21 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:59.010190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 712/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 20 13:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:39:59.014620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2775e-7fb4-4034-816a-7438da3dad97 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:39:59.014914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2775e-7fb4-4034-816a-7438da3dad97 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:39:59.015195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2775e-7fb4-4034-816a-7438da3dad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:39:59.087114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:39:59.090029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0bc2775e-7fb4-4034-816a-7438da3dad97 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:39:59.092372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0bc2775e-7fb4-4034-816a-7438da3dad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:39:59.208579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 701/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 20 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:01.724241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:01.724775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:01.724775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:01.726199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:01.732122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a034-aaa2-456f-bf1e-af284d61e537 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:01.732581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a034-aaa2-456f-bf1e-af284d61e537 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:01.732723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a034-aaa2-456f-bf1e-af284d61e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:01.796120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5a31a034-aaa2-456f-bf1e-af284d61e537 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:01.797341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5a31a034-aaa2-456f-bf1e-af284d61e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:01.853491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:01.895367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:01.939600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:01.941193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:02.086042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b1248-0713-4020-950c-09d8869cdc0b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:02.158634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:02.198674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:02.199320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:02.199605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:02.199881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:02.201541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:02.288836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:02.290970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04210d-e45a-4e3d-8769-8beeed39c9d2 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:02.315069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 714/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:03.247166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a803-440c-470b-a568-7a5044656262 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:03.247740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a803-440c-470b-a568-7a5044656262 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:03.247740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a803-440c-470b-a568-7a5044656262 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:03.249159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:03.254162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841e5e-8b51-4d58-9f4b-46487776ad90 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:03.254586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841e5e-8b51-4d58-9f4b-46487776ad90 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:03.254702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef841e5e-8b51-4d58-9f4b-46487776ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:03.328886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ef841e5e-8b51-4d58-9f4b-46487776ad90 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:03.330120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef841e5e-8b51-4d58-9f4b-46487776ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:03.356917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:03.428100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:03.578344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116a803-440c-470b-a568-7a5044656262 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:03.579807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f116a803-440c-470b-a568-7a5044656262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:03.728795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116a803-440c-470b-a568-7a5044656262 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:03.768208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:03.841902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:03.842475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:03.842761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:03.843039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:03.844732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:03.932955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:03.934564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912ac3-3cbd-4b6e-9dbf-99afb2776e7f service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:03.952425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 704/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:04.840806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:04.841368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:04.841368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:04.842752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:04.847538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac75e8-b0d0-4cc6-8a14-934306cc18b8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:04.847974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac75e8-b0d0-4cc6-8a14-934306cc18b8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:04.848084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac75e8-b0d0-4cc6-8a14-934306cc18b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:04.904013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:04.926421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1fac75e8-b0d0-4cc6-8a14-934306cc18b8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:04.927633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1fac75e8-b0d0-4cc6-8a14-934306cc18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:05.030436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:05.180414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:05.182435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:05.331330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43623d6f-512c-4b60-982b-07a04b3ce0a0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:05.343745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:05.444672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:05.445017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:05.445303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:05.445846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:05.447523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:05.536797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:05.538425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2d75-ec7a-4388-8c6a-0017babc418a service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:05.556796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 717/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:06.418493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:06.420305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:06.420305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:06.420639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:06.425610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c5833-5a72-4c4e-b7c4-2ff47028b115 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:06.426083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c5833-5a72-4c4e-b7c4-2ff47028b115 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:06.426211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c5833-5a72-4c4e-b7c4-2ff47028b115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:06.444532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:06.502464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ca2c5833-5a72-4c4e-b7c4-2ff47028b115 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:06.503687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ca2c5833-5a72-4c4e-b7c4-2ff47028b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:06.600734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:06.749405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:06.750844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:06.858823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:06.894665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de924be-0b73-4fcc-85a9-ff17a6c86e49 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:07.006961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:07.007527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:07.007814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:07.008094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:07.010362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:07.084521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:07.098358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:07.100006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5abf-197c-4ddf-92eb-77f1da8a1d1b service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:07.117855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 707/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:07.975848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:07.976456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:07.976456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:07.977900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:07.982843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99e82-a413-43f5-9805-76545508bd30 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:07.983286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99e82-a413-43f5-9805-76545508bd30 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:07.983436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99e82-a413-43f5-9805-76545508bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:08.056169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1ed99e82-a413-43f5-9805-76545508bd30 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:08.057395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1ed99e82-a413-43f5-9805-76545508bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:08.153126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:08.303107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:08.304663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:08.387197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:08.448206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42f70-dd6a-4914-ae31-f74683491527 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:08.559800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:08.560405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:08.560698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:08.560980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:08.562620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:08.610664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:08.653223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:08.654821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c34e-01fe-464e-b302-d779a47aabe0 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:08.673087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 720/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:09.474408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:09.474985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:09.475149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:09.476766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:09.482532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad33f-743f-440b-9a68-a3ee4ee578a3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:09.482953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad33f-743f-440b-9a68-a3ee4ee578a3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:09.483088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad33f-743f-440b-9a68-a3ee4ee578a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:09.556607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2e8ad33f-743f-440b-9a68-a3ee4ee578a3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:09.557860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e8ad33f-743f-440b-9a68-a3ee4ee578a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:09.653729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:09.805881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:09.807319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:09.856807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:09.954940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ee63-d635-409e-bd3d-76d2882b14b9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:10.067003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:10.067644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:10.067935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:10.068246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:10.069896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:10.077169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:10.161226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:10.163523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da54376-d3cd-4e5e-a29b-6345f81119b7 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:10.182833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 710/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:10.972992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:10.973639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:10.973639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:10.974960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:10.980427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be2b-0370-4165-a1e6-6ef574906ba5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:10.980870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be2b-0370-4165-a1e6-6ef574906ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:10.980993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be2b-0370-4165-a1e6-6ef574906ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:11.054137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ef86be2b-0370-4165-a1e6-6ef574906ba5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:11.055340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ef86be2b-0370-4165-a1e6-6ef574906ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:11.127163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:11.169135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:11.318350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:11.319798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:11.338006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:11.474620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a556d8-5aaf-422a-9af0-b9e762e28b13 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:11.562775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:11.589536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:11.590150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:11.590441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:11.590723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:11.592416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:11.689163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:11.690798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd14b-bd3f-4e98-b117-9496f66dfc4e service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:11.709701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 723/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:12.510837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:12.511408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:12.511408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:12.512806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:12.517632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd49a-9c9b-43ef-9ab4-84c18a936102 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:12.518063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd49a-9c9b-43ef-9ab4-84c18a936102 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:12.518205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd49a-9c9b-43ef-9ab4-84c18a936102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:12.592782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-49dcd49a-9c9b-43ef-9ab4-84c18a936102 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:12.593988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-49dcd49a-9c9b-43ef-9ab4-84c18a936102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:12.635292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:12.690848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:40:12.840641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:12.842255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:12.986690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9c819-d2da-4d64-86da-8bffefd566c9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:13.039421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:13.102056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:13.103254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:13.103621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:13.103905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:13.105621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:13.195381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:13.197513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b209a42-ef43-43a1-a3a8-f9cf3e0f1c79 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:13.216710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 713/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:14.043847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:14.044442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:14.044552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:14.045893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:14.050823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a489-dce3-414c-9435-c30a0291bec5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:14.051269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a489-dce3-414c-9435-c30a0291bec5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:14.051471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a489-dce3-414c-9435-c30a0291bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:14.126121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6bc7a489-dce3-414c-9435-c30a0291bec5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:14.127346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6bc7a489-dce3-414c-9435-c30a0291bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:14.129400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:14.224359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:14.376986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:14.378437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:14.523747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eefe70-14bc-46a0-a632-7c4e517545a3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:14.551109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:14.639262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:14.639942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:14.640255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:14.640543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:14.642772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:14.737047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:14.738698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11619f-5ca1-4ea6-b20f-3f96570ba1e7 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:14.756432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 726/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:16.715384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:16.715903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:16.716030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:16.717347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:16.722769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e10f9-225c-4706-a05a-2c4fd9f5f667 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:16.723171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e10f9-225c-4706-a05a-2c4fd9f5f667 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:16.723331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e10f9-225c-4706-a05a-2c4fd9f5f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:16.763304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:16.788047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bb9e10f9-225c-4706-a05a-2c4fd9f5f667 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:16.789291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bb9e10f9-225c-4706-a05a-2c4fd9f5f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:16.884708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:16.922570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:16.924092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:17.026178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9ea2d-ae43-4528-bed5-f294142bd4f0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:17.058043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:17.100128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:17.100804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:17.101088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:17.101364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:17.103609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:17.210826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:17.212848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd04bb-a9b2-4142-a76e-cb7280eef1aa service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:17.231840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 716/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:19.388116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79071198-b623-4404-8ca6-8657cef67544 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:19.388683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79071198-b623-4404-8ca6-8657cef67544 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:19.388808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79071198-b623-4404-8ca6-8657cef67544 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:19.390118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:19.395438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040e7f5-7764-468d-af23-e22e7126b28e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:19.395895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040e7f5-7764-468d-af23-e22e7126b28e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:19.395994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040e7f5-7764-468d-af23-e22e7126b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:19.459752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4040e7f5-7764-468d-af23-e22e7126b28e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:19.460998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4040e7f5-7764-468d-af23-e22e7126b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:19.473753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:19.561068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:19.598714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79071198-b623-4404-8ca6-8657cef67544 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:19.600273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-79071198-b623-4404-8ca6-8657cef67544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:19.703511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79071198-b623-4404-8ca6-8657cef67544 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:19.715415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:19.776597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:19.777243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:19.777529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:19.777809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:19.779450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:19.891478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:19.892948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5764f-4db8-46ba-a2fa-744c0ca55c54 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:19.911089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 729/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:22.360240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:22.360794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:22.360794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:22.362186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:22.367973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625678-46cf-4a63-8b15-0a46bc15e29f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:22.368410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625678-46cf-4a63-8b15-0a46bc15e29f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:22.369175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625678-46cf-4a63-8b15-0a46bc15e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:22.416981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:22.435348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4d625678-46cf-4a63-8b15-0a46bc15e29f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:22.436624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4d625678-46cf-4a63-8b15-0a46bc15e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:22.531301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:40:22.571821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:22.573420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:22.677548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769807e-9e26-4e3c-ab9b-b6e53fae58a3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:22.717242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:22.750669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:22.751310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:22.751597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:22.751868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:22.753523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:22.860283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:22.861728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4fc20-83b6-4b45-9e63-915729fc6f0f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:22.880288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 719/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:25.012423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:25.012983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:25.012983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:25.014357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:25.019625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145059a-66e9-4c4d-8a5e-ce33e63b5ee7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:25.020027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145059a-66e9-4c4d-8a5e-ce33e63b5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:25.020186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145059a-66e9-4c4d-8a5e-ce33e63b5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:25.083693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a145059a-66e9-4c4d-8a5e-ce33e63b5ee7 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:25.084936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a145059a-66e9-4c4d-8a5e-ce33e63b5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:25.106065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:25.183704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:25.222138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:25.223710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:25.338414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462bb55-aa10-42eb-aeef-621de3d7eb07 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:25.358510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:25.422931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:25.423588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:25.423876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:25.424155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:25.425923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:25.534662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:25.536245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb5098-bcd8-4dd9-bd80-787ab4bb0fc6 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:25.554743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 732/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:27.639119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:27.639516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:27.639685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:27.641102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:27.646430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839a5b-2171-4115-b5bd-410ae3b5d7c2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:27.646848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839a5b-2171-4115-b5bd-410ae3b5d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:27.646999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839a5b-2171-4115-b5bd-410ae3b5d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:27.709246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:27.711986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-de839a5b-2171-4115-b5bd-410ae3b5d7c2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:27.713802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-de839a5b-2171-4115-b5bd-410ae3b5d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:27.810978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:27.849518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:27.851103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:27.957016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352419fb-9c89-43b5-b875-625ff0195e65 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:28.004975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:28.029410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:28.030047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:28.030332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:28.030608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:28.032290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:28.141566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:28.143027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4419da-53ef-4d3f-b236-9c7e6e3d3afd service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:28.162421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 722/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:30.256339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:30.256866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:30.257016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:30.258269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:30.263636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caa9f-def8-4e1d-bd46-6f5ed59f267e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:30.264059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caa9f-def8-4e1d-bd46-6f5ed59f267e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:30.264214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caa9f-def8-4e1d-bd46-6f5ed59f267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:30.327546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-769caa9f-def8-4e1d-bd46-6f5ed59f267e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:30.328769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-769caa9f-def8-4e1d-bd46-6f5ed59f267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:30.359742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:30.429203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:30.468595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:30.470131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:30.572108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66942201-34b2-4b60-8f21-596e816d1318 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:30.600402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:30.652668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:30.653328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:30.653615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:30.653897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:30.655681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:30.766613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:30.768152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098fd4-6d42-4f75-bf08-21dbdc7e59b3 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:30.786462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 735/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:32.848125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:32.848633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:32.848732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:32.850092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:32.856298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd84e-b9df-4dfb-ab1c-793827720f05 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:32.856705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd84e-b9df-4dfb-ab1c-793827720f05 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:32.856870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd84e-b9df-4dfb-ab1c-793827720f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:32.920755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-03ebd84e-b9df-4dfb-ab1c-793827720f05 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:32.921972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-03ebd84e-b9df-4dfb-ab1c-793827720f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:32.930162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:33.018091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:33.055587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:33.057773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:33.159803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70c47a-ac89-4bc6-8305-ac478d007994 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:33.218737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:33.236829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:33.237511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:33.237802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:33.238084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:33.239744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:33.347480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:33.348971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99010cfb-ad66-4945-add5-7ae7e971f462 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:33.367512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 725/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:35.446375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:35.447477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:35.447477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:35.448899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:35.454245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570c4f-0120-44df-9c9d-9475279fa633 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:35.454695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570c4f-0120-44df-9c9d-9475279fa633 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:35.454794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570c4f-0120-44df-9c9d-9475279fa633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:35.519100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-14570c4f-0120-44df-9c9d-9475279fa633 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:35.520395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-14570c4f-0120-44df-9c9d-9475279fa633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:35.559199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:35.616840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:35.655085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:35.656711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:35.770362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e593aa9-db1e-4cdb-adc8-88a724ae4f10 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:35.807164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:35.842729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:35.843377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:35.843666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:35.843948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:35.845638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:35.953435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:35.954880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b216-2ebd-40e8-aafe-b4e688414073 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:35.974454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 738/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:38.016560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:38.017128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:38.017128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:38.018517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:38.023804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a17f7-5271-423e-be6a-74b3909e5081 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:38.024249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a17f7-5271-423e-be6a-74b3909e5081 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:38.024402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a17f7-5271-423e-be6a-74b3909e5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:38.089398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-607a17f7-5271-423e-be6a-74b3909e5081 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:38.090632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-607a17f7-5271-423e-be6a-74b3909e5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:38.109324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:38.194881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:38.232932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:38.234500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:38.339864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051ff95-8539-4ebf-a446-73fec6985dee None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:38.407965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:38.415995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:38.416780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:38.417067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:38.417349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:38.419034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:38.646396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:38.647849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f352-3eb4-4742-9ceb-a80215f16ffb service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:38.666763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 728/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:40.708227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:40.708796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:40.708796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:40.710217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:40:40.715600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564374c0-9fae-4c71-a352-a2facf15aa55 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:40.716004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564374c0-9fae-4c71-a352-a2facf15aa55 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:40.716160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564374c0-9fae-4c71-a352-a2facf15aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:40.781531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-564374c0-9fae-4c71-a352-a2facf15aa55 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:40:40.782739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-564374c0-9fae-4c71-a352-a2facf15aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:40.830267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:40.878716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:40:40.918520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:40:40.920071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:41.022752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d221a36-8383-457b-b14f-6fcc7d2066cd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:40:41.069263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:41.097418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:40:41.098071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:40:41.098359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:40:41.098638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:40:41.100324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:40:41.209673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:40:41.211045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc42809-6f23-45d9-a913-22116a5e9310 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:40:41.229251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 741/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:40:50.876915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=22 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:40:51.226948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=66 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:00.906197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c0eb-7f4a-417c-8ca4-91974720abe0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:00.906738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c0eb-7f4a-417c-8ca4-91974720abe0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:00.906738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172c0eb-7f4a-417c-8ca4-91974720abe0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:00.908128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 730/1471] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:00.913453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56df7-91e8-4d3e-8a17-da643a37f73a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:00.913842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56df7-91e8-4d3e-8a17-da643a37f73a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:00.914024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56df7-91e8-4d3e-8a17-da643a37f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:00.979484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-efd56df7-91e8-4d3e-8a17-da643a37f73a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:00.980731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-efd56df7-91e8-4d3e-8a17-da643a37f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:01.075371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 742/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:41:01.161481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:01.161770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:01.162054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:01.163412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 731/1473] 10.222.0.17 () {54 vars in 966 bytes} [Wed Jul 20 13:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:01.168880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052fe5-9773-43cf-8f4c-97f8c353176d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:01.169180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052fe5-9773-43cf-8f4c-97f8c353176d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:01.169467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052fe5-9773-43cf-8f4c-97f8c353176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:01.243628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e0052fe5-9773-43cf-8f4c-97f8c353176d None None] MFA Rules not processed for user `fcd9ef87632c49399f3ec6a92ce92709`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:01.244936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e0052fe5-9773-43cf-8f4c-97f8c353176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:01.265663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:01.321639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 743/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Wed Jul 20 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:01.329257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:01.330808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:01.434874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c1da-0b5f-467a-b879-35bd9edd555e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:01.507595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:01.508268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:01.508560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:01.508838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:01.511007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:01.565319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:01.619326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:01.620798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739c3d-1a4e-4946-9a62-10ce26de3ac2 service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:01.639450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 732/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:03.767837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:03.768439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:03.768439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:03.769801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 744/1476] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:03.775169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4191-29d2-4204-86c1-3994e6e88d6d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:03.775592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4191-29d2-4204-86c1-3994e6e88d6d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:03.775741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4191-29d2-4204-86c1-3994e6e88d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:03.839613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9d8a4191-29d2-4204-86c1-3994e6e88d6d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:03.840855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9d8a4191-29d2-4204-86c1-3994e6e88d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:03.936364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 733/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:03.959543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:03.961111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:04.088991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee918-8e13-4eb9-81c0-2e4b24d1d94e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:04.137226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:04.182450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:04.183103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:04.183385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:04.183664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:04.184414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:04.186206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:41:04.186206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:41:04.186206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:41:04.187407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d62b5-ee7f-4bcd-827d-3947bdc07f7e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:04.206099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 745/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 20 13:41:03 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:41:06.296550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:06.297110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:06.297110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:06.298497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 734/1479] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:06.303783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de8ea-08d5-4dc8-814e-a647a41ad69e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:06.304251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de8ea-08d5-4dc8-814e-a647a41ad69e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:06.304360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de8ea-08d5-4dc8-814e-a647a41ad69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:06.368897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e05de8ea-08d5-4dc8-814e-a647a41ad69e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:06.370146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e05de8ea-08d5-4dc8-814e-a647a41ad69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:06.465467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 746/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:41:06.513799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:06.515542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:06.526083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:06.667249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe18339-6a70-489d-94ef-53d2887ea46b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:06.746235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:06.779482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:06.780125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:06.780434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:06.780712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:06.782343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:06.869025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:06.870590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b797e2f-3be0-4751-aac7-fc6ea14ffb8f service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:06.888813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 735/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:09.083374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:09.084054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:09.084054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:09.085363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 747/1482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:09.091405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260973-49b2-4b76-a0f9-042d06801cd9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:09.091862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260973-49b2-4b76-a0f9-042d06801cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:09.091973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260973-49b2-4b76-a0f9-042d06801cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:09.155148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dd260973-49b2-4b76-a0f9-042d06801cd9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:09.156368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dd260973-49b2-4b76-a0f9-042d06801cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:09.201462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:09.250636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 736/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:09.286957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:09.288534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:09.312380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:09.392597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957b1f9-4069-4182-8885-656e8f56a5c6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:09.464865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:09.465511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:09.465796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:09.466074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:09.467714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:09.541940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:09.576217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:09.577660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c12a6-0149-4d05-a2b4-50862634f7bd service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:09.595725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 748/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:11.688926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:11.689391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:11.689496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:11.690926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 737/1485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:11.696245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13630-3959-46e4-8b29-14082f99dff7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:11.696670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13630-3959-46e4-8b29-14082f99dff7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:11.696881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13630-3959-46e4-8b29-14082f99dff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:11.762541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4fb13630-3959-46e4-8b29-14082f99dff7 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:11.763773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4fb13630-3959-46e4-8b29-14082f99dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:11.860210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 749/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:11.898380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:11.899958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:12.002093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33da2a-cd98-4385-94d9-d43546e2bf86 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:12.075457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:12.077421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:12.078223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:12.078693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:12.079128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:12.080999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:12.189023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:12.190479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97633f41-234b-4937-b733-fcac9c3aee7e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:12.209281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 738/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:14.443715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:14.444257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:14.444257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:14.446131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 750/1488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:14.452383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8d28c-1ee2-45fe-bf7e-4fc47159f695 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:14.452814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8d28c-1ee2-45fe-bf7e-4fc47159f695 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:14.452975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8d28c-1ee2-45fe-bf7e-4fc47159f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:14.518426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0cb8d28c-1ee2-45fe-bf7e-4fc47159f695 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:14.519618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0cb8d28c-1ee2-45fe-bf7e-4fc47159f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:14.571674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:14.615052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 739/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:14.661471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:14.663213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:14.702195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:14.771329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe525-a11d-4be1-b99b-7177851f301b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:14.843657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:14.844342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:14.844630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:14.844908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:14.846552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:14.927142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:14.957964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:14.959351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac088da-a9ad-4c0d-9f9d-adce519d5d51 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:15.096183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 751/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:17.325525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:17.326096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:17.326096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:17.327462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 740/1491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 20 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:41:17.332885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f062fc-2cb8-458d-8c78-55ecd8eda459 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:17.333302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f062fc-2cb8-458d-8c78-55ecd8eda459 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:17.333455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f062fc-2cb8-458d-8c78-55ecd8eda459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:17.398421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-90f062fc-2cb8-458d-8c78-55ecd8eda459 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:41:17.399652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-90f062fc-2cb8-458d-8c78-55ecd8eda459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:17.497844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 752/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 20 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:41:17.537375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:41:17.538924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:17.644844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504235-d5fb-42ce-8e77-8e0117725e95 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:41:17.719326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:41:17.719965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:41:17.720271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:41:17.720546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:41:17.722177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:41:17.732001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:17.831025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:41:17.833472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94facff5-9773-42d7-a263-9b1dddc60a21 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:41:17.854556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 741/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:41:27.495894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=82 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:41:27.851665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=50 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:12.523199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:12.523765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:12.523765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:12.597137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:43:12.598343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:12.698585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 753/1494] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:43:12.706904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:12.707386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:12.707501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:12.783556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:43:12.784740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:12.880971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 742/1495] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:43:12.885700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:12.886911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:12.898282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715651-c5c0-4850-8ca3-e582778b40c2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:12.960933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:12.995098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:12.995756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:12.996054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:12.996369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:12.997090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:43:12.997397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:12.998406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:12.998406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:43:12.998406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:43:12.999297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.010888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 754/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:43:13.019202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:13.028861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb159a3-d090-442f-91fb-6c3540c13be3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:13.095933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:13.130611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:13.131270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.131559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.131839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.132578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:13.134342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:13.134342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:43:13.134342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:43:13.135540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.192003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 743/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:43:13 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:43:13.196403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:13.198061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:13.233003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cff7b-b4ff-4b84-a2f2-caff4128ba28 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:13.328348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:13.334421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.334727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.335014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.335737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:13.336829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:13.336829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:43:13.336829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:43:13.338600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.382476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 755/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:43:13 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:43:13.387257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:13.388905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:13.452028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1aa96-fd5d-4be0-a93f-bece55df2279 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:13.534957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:13.546725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:13.547400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.547689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.547966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.548731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:13.549755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:13.549755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:43:13.549755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:43:13.550654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.563131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 744/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:43:13.567156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:13.568722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:13.580895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278f25-f696-4d2e-b3d0-6fc62e4b03dc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:13.605890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:13.677068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:13.677732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.678016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.678292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.679020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:13.680039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:13.680039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:43:13.680039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:43:13.680951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc964c-2fe2-4e9f-9793-36faab0aa2ff admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.693153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 756/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:43:13.697860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:13.699411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:13.732564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135407d3-be2d-4921-8359-1e9c87b0d252 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:13.826539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:13.827669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.827955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.828263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] PATH_INFO: `/v3/projects/43242ba44f174a27912ecf6b67599ef5/users/a948ee708ec54224b67b756f2a0e0041/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.850097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=43242ba44f174a27912ecf6b67599ef5, user_id=a948ee708ec54224b67b756f2a0e0041, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:13.851083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:13.851083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:43:13.851083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:43:13.853113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc5a47-fb04-4e0a-ba87-bcd464e79cca admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:13.876872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 745/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:43:13 2022] PUT /identity/v3/projects/43242ba44f174a27912ecf6b67599ef5/users/a948ee708ec54224b67b756f2a0e0041/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:43:13.889577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0befb-5ef8-4aff-99da-8d7bf9ac88d0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:13.889870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0befb-5ef8-4aff-99da-8d7bf9ac88d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:13.890176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0befb-5ef8-4aff-99da-8d7bf9ac88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:13.944364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4cc0befb-5ef8-4aff-99da-8d7bf9ac88d0 None None] MFA Rules not processed for user `a948ee708ec54224b67b756f2a0e0041`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:43:13.945618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4cc0befb-5ef8-4aff-99da-8d7bf9ac88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:14.022086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 757/1502] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:43:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:43:14.035597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.035893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.036182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.037610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 746/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 20 13:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:43:14.042392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e175c-22ea-4e11-9441-35997b970963 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.042686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e175c-22ea-4e11-9441-35997b970963 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.042968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e175c-22ea-4e11-9441-35997b970963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.074120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:14.117923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-148e175c-22ea-4e11-9441-35997b970963 None None] MFA Rules not processed for user `084b1b3181f34a2dacaa31f937f5d953`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:43:14.119673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-148e175c-22ea-4e11-9441-35997b970963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:14.193970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 758/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 20 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:43:14.202609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:14.204139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:14.253539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:14.308118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801c60-3533-46f0-b182-a680de1e8961 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:14.379806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:14.380412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.380703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.380987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.382644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:14.480089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:14.485562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:14.489194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:14.504480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 747/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:43:14.546165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c43ef-f258-43a5-80e9-72f75f4a36ff None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.546460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c43ef-f258-43a5-80e9-72f75f4a36ff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.546738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c43ef-f258-43a5-80e9-72f75f4a36ff None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.548041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 759/1506] 10.222.0.17 () {52 vars in 829 bytes} [Wed Jul 20 13:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:43:14.551533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:14.552797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:14.651859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf1651-8784-4a37-aad2-bdf262b14c11 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:14.746173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:14.747040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.747324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.747696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] PATH_INFO: `/v3/users/a948ee708ec54224b67b756f2a0e0041` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.760254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a948ee708ec54224b67b756f2a0e0041)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:14.761281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:14.761281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:43:14.761281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:43:14.762483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:14.772016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:14.824634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a948ee708ec54224b67b756f2a0e0041'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:14.842493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a948ee708ec54224b67b756f2a0e0041'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:14.855130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a948ee708ec54224b67b756f2a0e0041'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:14.864185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a948ee708ec54224b67b756f2a0e0041'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:14.864846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a948ee708ec54224b67b756f2a0e0041'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:14.871589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 748/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:43:14 2022] DELETE /identity/v3/users/a948ee708ec54224b67b756f2a0e0041 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:43:14.876162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:14.876660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:14.876756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:14.933682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:43:14.934921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:15.013974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:15.027401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 760/1508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:43:15.036996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:15.038270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:15.136864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3f34-52d0-427d-8e4e-f9c123744176 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:15.191035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:15.212315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:15.212966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:15.213271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:15.213548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:15.215182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:15.325888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:15.327621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4b724-1273-447e-a723-cc7eb96d1a36 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:15.346671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 749/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:43:15.678293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:43:15.679527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:43:15.690812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c2db8-891b-41b2-80e6-50bfed2d7238 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:43:15.791264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:43:15.792099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:43:15.792497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:43:15.792816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] PATH_INFO: `/v3/projects/43242ba44f174a27912ecf6b67599ef5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:43:15.803928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43242ba44f174a27912ecf6b67599ef5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:43:15.805126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:43:15.805126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:43:15.805126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:43:15.806426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:43:15.873834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43242ba44f174a27912ecf6b67599ef5', 'request_id': 'req-70a5678c-e914-4e27-b0e1-22c2e3c5e202'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:15.886222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43242ba44f174a27912ecf6b67599ef5', 'request_id': 'req-70a5678c-e914-4e27-b0e1-22c2e3c5e202'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:15.893944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43242ba44f174a27912ecf6b67599ef5', 'request_id': 'req-70a5678c-e914-4e27-b0e1-22c2e3c5e202'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:15.927827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] The token cache is being invalidate because project 43242ba44f174a27912ecf6b67599ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:43:15.928121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:15.928592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70a5678c-e914-4e27-b0e1-22c2e3c5e202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:43:15.930150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 761/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:43:15 2022] DELETE /identity/v3/projects/43242ba44f174a27912ecf6b67599ef5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:43:25.344070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=62 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:43:25.925383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:44:56.888461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:56.889019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:56.889019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:56.890380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:44:56.895612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4273-b4ed-4ea2-a265-c5a21112d42f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:56.896043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4273-b4ed-4ea2-a265-c5a21112d42f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:56.896176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4273-b4ed-4ea2-a265-c5a21112d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:56.976801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-903d4273-b4ed-4ea2-a265-c5a21112d42f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:44:56.978035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-903d4273-b4ed-4ea2-a265-c5a21112d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:44:57.088796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:44:57.245006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:44:57.247087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:44:57.365098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a7b9d-0cda-4800-9e03-6c21a48d8bd4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:44:57.370578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:44:57.371224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:57.371515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:57.371801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:57.380442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:44:57.382043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea3410-a26f-4d56-959e-72455555dc1a service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:44:57.393080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 751/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:44:58.219167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6759-3ac0-4b25-8804-96d949123478 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:58.219730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6759-3ac0-4b25-8804-96d949123478 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:58.219730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6759-3ac0-4b25-8804-96d949123478 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:58.221113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:44:58.225848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcc88-8d9d-4884-b594-25958aa8a247 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:58.226242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcc88-8d9d-4884-b594-25958aa8a247 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:58.226421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fcc88-8d9d-4884-b594-25958aa8a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:58.244115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-563fcc88-8d9d-4884-b594-25958aa8a247 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:44:58.245343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-563fcc88-8d9d-4884-b594-25958aa8a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:44:58.253144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:44:58.402921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6759-3ac0-4b25-8804-96d949123478 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:44:58.418072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6759-3ac0-4b25-8804-96d949123478 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:44:58.423797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:44:58.424481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:58.424765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:58.425044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:58.433548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:44:58.435138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffe003-fef7-43f9-9df0-086c3120725f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:44:58.444795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 764/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:44:59.086518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afd47-8daf-431e-97c7-0a5f53201a2a None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:59.086814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afd47-8daf-431e-97c7-0a5f53201a2a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:59.087100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afd47-8daf-431e-97c7-0a5f53201a2a None None] PATH_INFO: `/v3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:59.088494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 753/1517] 10.222.0.48 () {54 vars in 925 bytes} [Wed Jul 20 13:44:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:44:59.095245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576757e-6895-4eae-9662-e4baf7f34331 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:44:59.095537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576757e-6895-4eae-9662-e4baf7f34331 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:44:59.095819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576757e-6895-4eae-9662-e4baf7f34331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:44:59.153067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2576757e-6895-4eae-9662-e4baf7f34331 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:44:59.154261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2576757e-6895-4eae-9662-e4baf7f34331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:44:59.171472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:44:59.227042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 765/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 20 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:45:03.050585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ec74-e6e5-4a81-ae41-9c9b4554a421 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:03.051107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ec74-e6e5-4a81-ae41-9c9b4554a421 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:03.051107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ec74-e6e5-4a81-ae41-9c9b4554a421 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:03.052526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 754/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 20 13:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:03.057569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9c59-ecaa-45fc-afbd-eb22de201c61 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:03.058057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9c59-ecaa-45fc-afbd-eb22de201c61 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:03.058170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9c59-ecaa-45fc-afbd-eb22de201c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:03.076335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-616d9c59-ecaa-45fc-afbd-eb22de201c61 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:03.077556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-616d9c59-ecaa-45fc-afbd-eb22de201c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:03.086226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 766/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 20 13:45:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:03.094137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ec74-e6e5-4a81-ae41-9c9b4554a421 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:03.107243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ec74-e6e5-4a81-ae41-9c9b4554a421 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:03.112729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:03.113381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:03.113671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:03.113951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:03.122264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:03.123952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250177d2-70e9-4829-b4dd-bb24a9a1af19 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:03.133611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 755/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:09.682567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b89d-313d-4aef-9506-a81c99cebccf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:09.683119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b89d-313d-4aef-9506-a81c99cebccf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:09.683119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b89d-313d-4aef-9506-a81c99cebccf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:09.684544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:09.690128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48867cd-8f48-42f9-9b49-2e18efe00e46 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:09.690563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48867cd-8f48-42f9-9b49-2e18efe00e46 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:09.690671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48867cd-8f48-42f9-9b49-2e18efe00e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:09.708787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d48867cd-8f48-42f9-9b49-2e18efe00e46 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:09.709975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d48867cd-8f48-42f9-9b49-2e18efe00e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:09.717726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:09.870042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0b89d-313d-4aef-9506-a81c99cebccf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:09.884698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0b89d-313d-4aef-9506-a81c99cebccf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:09.890207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:09.890790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:09.891079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:09.891364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:09.899548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:09.901703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8bb3-2246-4a3e-b0aa-86f2bf4ee2d7 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:09.911837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 768/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:10.731804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b89d-c017-4390-bddf-b5c944a9d55e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:10.732400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b89d-c017-4390-bddf-b5c944a9d55e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:10.732400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b89d-c017-4390-bddf-b5c944a9d55e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:10.734215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 13:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:10.739093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ffbfe-7e8e-4245-86c7-2bf5c45e663f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:10.739524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ffbfe-7e8e-4245-86c7-2bf5c45e663f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:10.739689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ffbfe-7e8e-4245-86c7-2bf5c45e663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:10.757942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1a0ffbfe-7e8e-4245-86c7-2bf5c45e663f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:10.759143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a0ffbfe-7e8e-4245-86c7-2bf5c45e663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:10.767636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:10.918182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70b89d-c017-4390-bddf-b5c944a9d55e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:10.933090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70b89d-c017-4390-bddf-b5c944a9d55e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:10.939133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:10.939765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:10.940058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:10.940381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:10.948477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:10.950068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076c2a2-3cdb-45c1-98f1-c22503f43ddd service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:10.960082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 758/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:14.870861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:14.871452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:14.871452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:14.872910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:14.878730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09559-7921-4785-bc45-29f9e7c13343 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:14.879159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09559-7921-4785-bc45-29f9e7c13343 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:14.879297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09559-7921-4785-bc45-29f9e7c13343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:14.897123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-57e09559-7921-4785-bc45-29f9e7c13343 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:14.898401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-57e09559-7921-4785-bc45-29f9e7c13343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:14.906230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:14.980584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:14.982275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:15.062844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98864114-596c-4784-b9bb-56d8a633d7a8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:15.066555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:15.067336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:15.067493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:15.067775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:15.076862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:15.078577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a8f56-75ca-4b26-a4a0-af533dde021f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:15.088300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 771/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:17.217135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3202-4cab-493a-9f85-aca8c2a00d3e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:17.218011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3202-4cab-493a-9f85-aca8c2a00d3e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:17.218196 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd3202-4cab-493a-9f85-aca8c2a00d3e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:17.219591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:17.224742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ee4e-b8c1-4d45-ba60-4c3b0a224909 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:17.225158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ee4e-b8c1-4d45-ba60-4c3b0a224909 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:17.225301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ee4e-b8c1-4d45-ba60-4c3b0a224909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:17.243721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eae2ee4e-b8c1-4d45-ba60-4c3b0a224909 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:17.244947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eae2ee4e-b8c1-4d45-ba60-4c3b0a224909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:17.253312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:45:17.291110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd3202-4cab-493a-9f85-aca8c2a00d3e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:17.304524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd3202-4cab-493a-9f85-aca8c2a00d3e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:17.310410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:17.312039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:17.312364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:17.312658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:17.323609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:17.325105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3871ab-4163-4cd8-b57f-b97cba8343a8 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:17.334837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 761/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:20.836989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:20.837546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:20.837546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:20.838901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:20.844040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bfa7-8ec4-4995-a7f7-5c960816fe4e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:20.844465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bfa7-8ec4-4995-a7f7-5c960816fe4e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:20.844647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bfa7-8ec4-4995-a7f7-5c960816fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:20.863486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2831bfa7-8ec4-4995-a7f7-5c960816fe4e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:20.864744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2831bfa7-8ec4-4995-a7f7-5c960816fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:20.872661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:21.174539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:21.176246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:21.239296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:45:21.252902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dddbe-4dfc-4a7a-921e-0c5e87c29032 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:21.256439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:21.257073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:21.257357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:21.257632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:21.266353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:21.267775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf4fa-dab2-4d5d-b45d-3fa8edcfaad6 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:21.277014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 774/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:23.404110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:23.404702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:23.404702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:23.406077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 13:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:45:23.411350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0ef9-6cd5-4384-81ca-bd8b65853f79 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:23.411766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0ef9-6cd5-4384-81ca-bd8b65853f79 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:23.411913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0ef9-6cd5-4384-81ca-bd8b65853f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:23.429704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-21cd0ef9-6cd5-4384-81ca-bd8b65853f79 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:45:23.430895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-21cd0ef9-6cd5-4384-81ca-bd8b65853f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:23.439197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:45:23.737771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:45:23.739432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:45:23.752815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f81e3-c120-443e-803f-709f1f4d46fa None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:45:23.756327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:45:23.756961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:45:23.757250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:45:23.757532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:45:23.766383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:45:23.767818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02af5-ffff-4d54-8ac4-1683ba8fb520 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:45:23.777129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 764/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:45:33.425017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:45:33.773062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:52.881518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:52.882177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:52.882177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:52.911194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:52.916593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:52.926467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 776/1540] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:46:52.935791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:52.937828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:52.938283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:52.969368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:52.971018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:52.985514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 765/1541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:52.988078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.002699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac49c4c-fb60-423d-a8b6-398bc5bc7a50 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.012960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.013651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.013939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.014218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.015510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:53.015817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.017469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c522b-d3df-41a7-b759-d6b959c8d4f9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.036667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 777/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:53.045149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.057046 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73116-2741-4bc4-ab13-116ae0f34882 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.057725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73116-2741-4bc4-ab13-116ae0f34882 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.058247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73116-2741-4bc4-ab13-116ae0f34882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.059299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737133c-04c3-4815-9662-17f559b99b25 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.064884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.065573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.065864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.066148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.066945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.069014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.097245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8bc73116-2741-4bc4-ab13-116ae0f34882 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.098878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8bc73116-2741-4bc4-ab13-116ae0f34882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.112645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 778/1543] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.124167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.124889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.125424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.125729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 766/1544] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:53.129813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.157509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.159114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.229037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0244-9056-484a-9553-f4dcaa1d83f2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.234775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.235462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.235758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.236038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.236772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.237808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:46:53.237808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:46:53.237808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:46:53.239023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.271628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 779/1545] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:46:53.274573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 767/1546] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:46:53.278028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.281145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.291732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e36c9-0155-4486-8462-14a889956ef6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.296499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09168e-3cff-43d4-826a-83a75e9b6335 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.304604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.305821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.306460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.307016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.307459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.307706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.307997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.308302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.309046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.309329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:53.309843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.310669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e53eb-24c1-48cc-b3f9-f5ecbb41a2e5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.317151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.338627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 780/1548] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:53.339075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 768/1548] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:53.340003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.340321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.340606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.348613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.367262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea4c38-6529-4a35-aea5-6e245a17e6bc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.372569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.374464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.379248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.381504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.382557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.383562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.385748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.389151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2e3a-0228-405c-bd99-6783221b815d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.394230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 769/1549] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.396944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.416886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 781/1550] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:53.418210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa5d8-5bc7-479c-a20b-2e8aca16230b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.418507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa5d8-5bc7-479c-a20b-2e8aca16230b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.418775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa5d8-5bc7-479c-a20b-2e8aca16230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.419011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863eaca-72bb-48b6-8f15-f0388558ea79 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.429484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.430556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.431155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.431935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.432890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.435043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.452981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-87daa5d8-5bc7-479c-a20b-2e8aca16230b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.454798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-87daa5d8-5bc7-479c-a20b-2e8aca16230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.473421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 782/1551] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.474887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55061-30f5-43db-966a-dac7216b66c2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.475184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55061-30f5-43db-966a-dac7216b66c2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.475474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55061-30f5-43db-966a-dac7216b66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.484792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 770/1552] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:53.486113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.502265 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6bd55061-30f5-43db-966a-dac7216b66c2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.503503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6bd55061-30f5-43db-966a-dac7216b66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.587855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fcd6-c126-427a-bc2c-6b325c266fa3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.590872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 783/1553] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.591906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158d08-ec14-413e-8802-2ea0cb86a5e4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.592218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158d08-ec14-413e-8802-2ea0cb86a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.592549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158d08-ec14-413e-8802-2ea0cb86a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.598358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.599269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.599564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.599850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] PATH_INFO: `/v3/projects/ef1e44c6f9fc41ffaf49a0fec012031b/users/b55c81544d4342fb89dd8dbce3400fe4/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.614548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c6158d08-ec14-413e-8802-2ea0cb86a5e4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.615778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c6158d08-ec14-413e-8802-2ea0cb86a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.617595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1e44c6f9fc41ffaf49a0fec012031b, user_id=b55c81544d4342fb89dd8dbce3400fe4, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.620435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.624499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 784/1554] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.624865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:53.626696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8b01-6c8d-4695-854b-9c53ef826150 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.627170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8b01-6c8d-4695-854b-9c53ef826150 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.627673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8b01-6c8d-4695-854b-9c53ef826150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.643882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 771/1555] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:53 2022] PUT /identity/v3/projects/ef1e44c6f9fc41ffaf49a0fec012031b/users/b55c81544d4342fb89dd8dbce3400fe4/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:53.648778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.653875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-072c8b01-6c8d-4695-854b-9c53ef826150 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.655112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-072c8b01-6c8d-4695-854b-9c53ef826150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.687708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:53.709978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293c2a-cae0-4cb0-8f9e-f4cdb8311e24 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.714927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.715656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.715945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.719629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 785/1556] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.719756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.719756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.719960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb573-e9c4-47ab-bddb-1dcab1b7562a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.719960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb573-e9c4-47ab-bddb-1dcab1b7562a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.719960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb573-e9c4-47ab-bddb-1dcab1b7562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.720230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.737308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-96dfb573-e9c4-47ab-bddb-1dcab1b7562a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.738455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-96dfb573-e9c4-47ab-bddb-1dcab1b7562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.744428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 772/1557] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:53.744428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.746668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 786/1558] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.747959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f57ec-cee1-491c-ae88-a68230272053 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.748279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f57ec-cee1-491c-ae88-a68230272053 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.748556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f57ec-cee1-491c-ae88-a68230272053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.753270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc1f1-989d-4345-8ba7-26cdf9cf6361 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.758172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.758937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.759344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.759725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.760588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:53.761004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.762099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:46:53.762099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:46:53.762099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:46:53.762993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4093a47-ec41-4498-afff-bef8b3cd2d12 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.766822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dd2f57ec-cee1-491c-ae88-a68230272053 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.768034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dd2f57ec-cee1-491c-ae88-a68230272053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.775586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 773/1559] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:53.775953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 787/1560] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.777349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a262fb-6983-4a57-b04f-67c6bbe5cf34 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.777635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a262fb-6983-4a57-b04f-67c6bbe5cf34 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.777910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a262fb-6983-4a57-b04f-67c6bbe5cf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.783971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.784594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.784893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.797083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-69a262fb-6983-4a57-b04f-67c6bbe5cf34 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.798289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-69a262fb-6983-4a57-b04f-67c6bbe5cf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.803979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.805179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.807324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 788/1561] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.808585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.808878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.809223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.813864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 774/1562] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.814646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.823900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df8da0-a483-4adb-9b93-8292a503e6b7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.828698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.829339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.829625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.829961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.830098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.830678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:53.830984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.831167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.832596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4082e-afc9-49b3-aabf-33c59463a02a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.838780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 789/1563] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.839630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.844499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 775/1564] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:53.845486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.845835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.846562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.850652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b71e-4a6b-437a-a33a-40c2b1da18ce None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.856327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.857021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.857313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.857595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.858872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.860556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d38e9a-c3b3-4cf4-aee2-1212097cb6e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.864179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.865395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.871096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 790/1565] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:53.872441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090a396-817a-40c4-b42a-94a686e34a97 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.872847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090a396-817a-40c4-b42a-94a686e34a97 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.873138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090a396-817a-40c4-b42a-94a686e34a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.877567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 776/1566] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.877567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.884136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e406b-17bd-4e49-84ed-ea640e085784 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.888620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.889260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.890090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.890366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.891046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.892400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5090a396-817a-40c4-b42a-94a686e34a97 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.892984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:53.893596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5090a396-817a-40c4-b42a-94a686e34a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.901780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 791/1567] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.903023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.903307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.903585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.921826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 777/1568] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:53.921826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.922129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:53.922944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:53.989669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 792/1569] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:53.990617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:53.991111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7243-f6c6-42e0-b2ea-648625698dcf admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:53.995725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:53.996421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:53.996715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:53.997000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:53.997730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:53.998045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:53.999700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.000749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689a71-254b-448a-9d15-96bfb187ab17 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.005617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.006246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.006531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.006808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.007491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.008527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:46:54.008527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:46:54.008527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:46:54.009698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.014134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 778/1570] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:54.014134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.035488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:54.044886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 793/1571] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:53 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.044886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.072621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f5f6f-db2b-4074-85c5-230fc627a014 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.107609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9717b-9163-4705-93b0-74df4d6fa3c4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.112936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.113604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.113893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.114176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.114906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.116557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.124802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.125456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.125758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.126029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.126672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 794/1572] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.130761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.136361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.137818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.140244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec28709-a7bf-4d4a-8b55-b76343c2fe74 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.144893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.145530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.145815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.146094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.146804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:54.147110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.147418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 779/1573] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:54.148228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.148818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.151846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:54.157922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42096-b0f5-4d31-aaad-8d190994cb0b service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.165346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 795/1574] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:54.166084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.166623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.167393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.167892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.168294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.169124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:54.169659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.172941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.179770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7335-2307-47ac-a4ac-3379bd86c639 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.184781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.185521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.185878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.187037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.187416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 780/1575] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:54.194887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.195107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.195200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.199942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12bf91-5781-4a42-85dc-eb3dd21f3d5a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.206633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.207299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.207586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.207862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.208632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:46:54.208943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.210562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.216681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 796/1576] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.217817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.231639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 781/1577] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:46:54.231639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.237049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899959e5-3b50-46d5-bd2b-c60c1df1fe1c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.238304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610f45-ef05-4ba3-9bd5-859811e7a741 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.242074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.242938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.243209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.243484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.243637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.244310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.244517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.244925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.245431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.246015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.246142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.248463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.276268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 782/1578] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.279715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 797/1579] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.279854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.280754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.290493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31535fa-e07e-4688-b1f6-05e5511f3b91 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.357133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfed76-9eaa-4c23-951f-59eedb28ebc6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.363265 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.363894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.364221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.364648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.365359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.367305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.376818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.377746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.378027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.378300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] PATH_INFO: `/v3/projects/4d8105a57b2a47d5851fc8ca3d13c9e3/users/7c1d0edb03914ac69ebdb833ee1c2d75/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.394217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8105a57b2a47d5851fc8ca3d13c9e3, user_id=7c1d0edb03914ac69ebdb833ee1c2d75, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.397097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.402062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 798/1580] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.402062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.415803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 783/1581] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:54 2022] PUT /identity/v3/projects/4d8105a57b2a47d5851fc8ca3d13c9e3/users/7c1d0edb03914ac69ebdb833ee1c2d75/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:54.416812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.442209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:54.484663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347eb65-7896-49ea-ad25-82b545f1e85e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.498600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f234-fa13-4b12-ab6e-bfb0a0d6c1e4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.508570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.509392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.509837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.510120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.511288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.512944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.525028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 784/1582] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.525028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.539936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064eff-4922-44ac-be0a-f9b4072988cc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.545329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.546763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.547237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.547521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.548367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.550414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.573065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:54.587284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 785/1583] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.588400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.593628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.594591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.594978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.595362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.596172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.598202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.637066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 799/1584] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.637868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.665912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d686-6f79-4690-adfa-f05b31ade969 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.716417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a584d4-0849-43f9-9061-9d646bd10154 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.722163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.723087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.723377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.723658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.724387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.726324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.734579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.735808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.736343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.736720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.737663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.739934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570d2db-8aed-472e-934f-77597b7dae48 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.752944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 800/1585] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.752944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.753216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 786/1586] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.753365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.753666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.753952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.762272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46624480-fd7d-4346-ae76-aaa954a7508a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.768518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.769273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.769624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.769971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.770755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.772794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.773541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:54.774770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:54.784917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 787/1587] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:54.785755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.802215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4dcb-1eac-45f7-a32d-63a950792416 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.804653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 801/1588] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.805944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.807547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.808354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.808697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.809046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.809887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.812153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.818414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c169ba-de3b-4f3b-b742-f523120c758a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.823674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.824307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 788/1589] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.824945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.829153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.829577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.829932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.830648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.832721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.836497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a52c-0ffe-48eb-97e8-12b6e08fa53d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.842482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.843172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.843491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.843733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.844457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.846507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.862351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:54.864853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 802/1590] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 295 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.866634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.875799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 789/1591] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:54 2022] POST /identity/v3/users => generated 285 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:54.876759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.885057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d07ee2-486a-43bb-a84e-f039ffc14620 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.888581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560f96-6cbb-41ee-a6c4-1cf694e3c0b0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.893787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.894469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.894757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.895038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.895772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.897434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.907760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.911529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 790/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.912761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.913206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.913658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.914911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.917999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.918816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.922460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:54.934634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 803/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.934634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.947184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d50c-e362-4e3a-9500-8117d53cebe5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.954329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.955111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.955595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.955996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:54.956971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:54.959116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:54.974881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 804/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:54.976114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:54.988483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9666-0149-4327-878e-85d03d4887ea admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.988877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e926852-c018-49a3-a54c-929b922d25d5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:54.992879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:54.993600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:54.993969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:54.994313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.000474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.001911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.002621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.003113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] PATH_INFO: `/v3/projects/4d7333e4bd914d24bf1a05e10d7bd7a1/users/f23c790443054398a773f19508158509/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.009493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.011089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.021844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7333e4bd914d24bf1a05e10d7bd7a1, user_id=f23c790443054398a773f19508158509, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.023578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 791/1595] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:55.023803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:46:55.023803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:46:55.023803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:46:55.024594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.026765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.035157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ad56-c3f1-4dd2-8590-8fdd98428542 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.041165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.041966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.042313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.042518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.043253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.045030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.048411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 805/1596] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:54 2022] PUT /identity/v3/projects/4d7333e4bd914d24bf1a05e10d7bd7a1/users/f23c790443054398a773f19508158509/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.049518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.059544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 792/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.059544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.070898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15608e83-b582-4cb3-a2db-2c02e28443bc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.124062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.136671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.137712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.138252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.139029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] PATH_INFO: `/v3/projects/ba279ef34ec4419e9438f5e6811c3ce1/users/baa6d72bd62f403095f8c6ba1c93f023/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.149105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3a626-a155-49ea-abb8-aa8a1bab6daf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.154963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.156783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.157095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.157345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.158181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.159925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.162090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba279ef34ec4419e9438f5e6811c3ce1, user_id=baa6d72bd62f403095f8c6ba1c93f023, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.165043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.171973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 806/1598] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.173030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.187307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14349-cb00-4132-b8c1-2deeb240caf0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.189464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 793/1599] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:55 2022] PUT /identity/v3/projects/ba279ef34ec4419e9438f5e6811c3ce1/users/baa6d72bd62f403095f8c6ba1c93f023/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.190396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.270297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.270985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.271272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.271548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.272431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.274288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd282-0b8a-4957-8566-1ce8fc518192 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.286113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e328620-934a-4a8e-a8aa-cf4a81801563 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.286318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 807/1600] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.287595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe002-e283-443f-a672-dfce918b8f7a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.287891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe002-e283-443f-a672-dfce918b8f7a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.288174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fe002-e283-443f-a672-dfce918b8f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.294289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.295340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.296343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.296786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.297669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.300436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.303467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.318370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 794/1601] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.320262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.320898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-973fe002-e283-443f-a672-dfce918b8f7a None None] MFA Rules not processed for user `f23c790443054398a773f19508158509`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:55.322163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-973fe002-e283-443f-a672-dfce918b8f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:55.336444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9b34f-f883-4d1f-9d72-c95718b1a11a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.342833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.343787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.344075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.344781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.345639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.347685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.364526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 795/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.364526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.379316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70876-8e0b-44c1-b718-4f368e6f76c0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.389135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.391448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.391896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.392344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.393617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.397346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.399828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 808/1603] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:55.401331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.401666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.401949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.411007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 796/1604] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:55.411968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.427053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426892cb-e220-44f8-ae49-3b51c14e13cb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.432183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.433254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.433608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.433945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] PATH_INFO: `/v3/projects/e90a23f25e0643ba933d1ca23b213ccd/users/fb0a981a9f544089a2c53a23cd93a38f/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.439364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] MFA Rules not processed for user `baa6d72bd62f403095f8c6ba1c93f023`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:55.441016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:55.458391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90a23f25e0643ba933d1ca23b213ccd, user_id=fb0a981a9f544089a2c53a23cd93a38f, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.462771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.493630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 797/1605] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:55 2022] PUT /identity/v3/projects/e90a23f25e0643ba933d1ca23b213ccd/users/fb0a981a9f544089a2c53a23cd93a38f/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.493630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.532550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.565175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 809/1606] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:55.566775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.591350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f19fa-bf7c-458c-862a-ecc0e581844a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.594792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd575-2227-42f6-833e-b1d6222e168d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.599885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.601350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.601989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.602676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] PATH_INFO: `/v3/projects/f4d1a070c0624b1e9e0b12d5eb0cb0b5/users/419fced725134a31bee9907051f2621b/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.608792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.609839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.611368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.611731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] PATH_INFO: `/v3/projects/cc6c042204f0471ba5c2f8a67604a802/users/f9cb52fe271348c1bc0ffda92063bf59/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.631420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d1a070c0624b1e9e0b12d5eb0cb0b5, user_id=419fced725134a31bee9907051f2621b, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.633998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6c042204f0471ba5c2f8a67604a802, user_id=f9cb52fe271348c1bc0ffda92063bf59, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.634898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6a13-f4dc-4923-b309-b9a033b68131 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.637609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.665412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 810/1607] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:55 2022] PUT /identity/v3/projects/cc6c042204f0471ba5c2f8a67604a802/users/f9cb52fe271348c1bc0ffda92063bf59/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.667086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:55.669693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 798/1608] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:55 2022] PUT /identity/v3/projects/f4d1a070c0624b1e9e0b12d5eb0cb0b5/users/419fced725134a31bee9907051f2621b/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.674764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0394f-bee7-473f-9c19-f4b26c2cdd69 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.675130 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0394f-bee7-473f-9c19-f4b26c2cdd69 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.675335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0394f-bee7-473f-9c19-f4b26c2cdd69 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.677441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 799/1609] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 20 13:46:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:46:55.678388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d477f-b6be-472c-bb95-c32b66b6bafa None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.678674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d477f-b6be-472c-bb95-c32b66b6bafa None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.678964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d477f-b6be-472c-bb95-c32b66b6bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.716287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-740d477f-b6be-472c-bb95-c32b66b6bafa None None] MFA Rules not processed for user `fb0a981a9f544089a2c53a23cd93a38f`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:55.720267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-740d477f-b6be-472c-bb95-c32b66b6bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:55.781461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b144286-22f7-40da-a718-195070ca6ae9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:55.794880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:55.796239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.796798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.797281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] PATH_INFO: `/v3/projects/18451dd39acd47df869fe875bc2dae66/users/624d5f06ae8e432bb967c6ce8956064a/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.812504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 800/1610] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:55.814111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653764d5-b8ab-4658-8a38-0fff4f31e779 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.814472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653764d5-b8ab-4658-8a38-0fff4f31e779 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.815413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653764d5-b8ab-4658-8a38-0fff4f31e779 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.816700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 801/1611] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 20 13:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:46:55.817746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.818101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.818557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.822276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18451dd39acd47df869fe875bc2dae66, user_id=624d5f06ae8e432bb967c6ce8956064a, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:55.827709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2858-8273-4133-8698-430e65bbf1b2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:55.840699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:55.841797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:55.847390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 811/1612] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:55 2022] PUT /identity/v3/projects/18451dd39acd47df869fe875bc2dae66/users/624d5f06ae8e432bb967c6ce8956064a/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:55.848766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdf0c-46ed-4bd9-957a-56f77683c3e6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.849039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdf0c-46ed-4bd9-957a-56f77683c3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.849396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdf0c-46ed-4bd9-957a-56f77683c3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:55.868683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-169fdf0c-46ed-4bd9-957a-56f77683c3e6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:55.870070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-169fdf0c-46ed-4bd9-957a-56f77683c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:55.876413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:55.951100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 812/1613] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:55.953575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ceb09-ddbf-4b8b-9d12-dca007cadea0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:55.953689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ceb09-ddbf-4b8b-9d12-dca007cadea0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:55.953887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ceb09-ddbf-4b8b-9d12-dca007cadea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.058469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 802/1614] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:56.058469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.058469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861db5f-8fee-4abd-9514-212c10e38fcd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.058469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.059608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.059608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.059608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.059608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.059972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5f4ceb09-ddbf-4b8b-9d12-dca007cadea0 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:56.060070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22fca2-f220-4584-a0d3-ca2c47511eaa admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.060167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f4ceb09-ddbf-4b8b-9d12-dca007cadea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:56.077608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 803/1615] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:56.079639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.079940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.080234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.094260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:56.102578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:56.103936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:56.135101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 813/1616] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 20 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:56.136532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.136829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.137109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.167259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] MFA Rules not processed for user `624d5f06ae8e432bb967c6ce8956064a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:56.168645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:56.189587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 804/1617] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 20 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:56.190501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.277525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64b695-4e91-4c7b-b1a9-424e5a327582 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.283598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 814/1618] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:56.287117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.287334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.287592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.287887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.289149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.305950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4a8e5-cff6-4667-8727-6894a4510665 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.314492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.315302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.315428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.315657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.371037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:56.403657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.408769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.438071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 805/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:56.439016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.452751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879aa0-a63b-4892-9bfa-fbd4cbca7e64 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.462472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.463785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.464302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.465438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.466380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.470106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.487518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.489348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.512247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 815/1620] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:56.515953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 806/1621] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:56 2022] POST /identity/v3/users => generated 297 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:56.517008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.517840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.562726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8b5a-4b24-457e-a523-01235d896418 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.564754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0527b-b0f0-4b98-bb62-8bd33b413017 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.576508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.578871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.579918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.580074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.580521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.580754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.581663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.582787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.692745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:56.698018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.700445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.711428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 816/1622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:56.713055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.729036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086096-69b9-4ad8-b97c-e41d850e35d1 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.734848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.735698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.735995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.736417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.737233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.739367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.765323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.776303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.779400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 817/1623] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:46:56 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:56.785362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.827630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 807/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:56.831981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.874700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087b08-2c9d-44a1-997b-97c377cb6ba6 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.898824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c624-038a-475c-9a63-5b1b7353cf7d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.903987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.904730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.905811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.905993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:56.906747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:56.908770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:56.925144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 818/1625] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:56.945178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:56.958679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd777-7b2c-4fcb-9786-7c7c28db0bf1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:56.965217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:56.966161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:56.966504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:56.966789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] PATH_INFO: `/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f/users/d9e7a4938c2249d797af668f073e43ad/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.018984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb12b8e691d5478ea1f54b29a4d3816f, user_id=d9e7a4938c2249d797af668f073e43ad, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.021721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.049288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 819/1626] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:56 2022] PUT /identity/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f/users/d9e7a4938c2249d797af668f073e43ad/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:57.054681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.086589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.087283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.087569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.087846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.088627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.090718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.115870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 808/1627] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:46:56 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:46:57.120018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.139916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125e78b-75b3-4477-9594-981cedc2fa68 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.190671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2670-e956-4ab5-a136-b33ecdf51eb5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.199101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.201050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.201343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.203662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.205264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.209043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.237969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 820/1628] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:46:57.238970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.258464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f31e3-7749-4b93-b91e-54956d861349 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.260240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:57.272813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.273691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.274045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.274786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.275763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.276003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.277178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.277775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.278768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.279732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] PATH_INFO: `/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f/users/d9e7a4938c2249d797af668f073e43ad/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.286762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb12b8e691d5478ea1f54b29a4d3816f, user_id=d9e7a4938c2249d797af668f073e43ad, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.292233 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 809/1629] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:57.294266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.297516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff4f4f-74ae-49c4-bad1-9db487d8a017 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.314188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4e23d-dbcb-4e51-84e9-5ec3ffd4e13b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.331607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 821/1630] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:57 2022] PUT /identity/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f/users/d9e7a4938c2249d797af668f073e43ad/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:57.341863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1864-d003-44d9-bffa-42b2c65c99bd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.342079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1864-d003-44d9-bffa-42b2c65c99bd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.342716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1864-d003-44d9-bffa-42b2c65c99bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.388294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d3cd1864-d003-44d9-bffa-42b2c65c99bd None None] MFA Rules not processed for user `d9e7a4938c2249d797af668f073e43ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:57.389672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d3cd1864-d003-44d9-bffa-42b2c65c99bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:57.390769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.396586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.397328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.397869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] PATH_INFO: `/v3/projects/c77d527ae2de476293b320de58bb5c4a/users/ca0393726c924c18b1adb561a317b72d/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.421577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d527ae2de476293b320de58bb5c4a, user_id=ca0393726c924c18b1adb561a317b72d, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.422178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:57.429115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffce920-3da1-49c0-941d-3e33a049403f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.451905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 810/1631] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:57 2022] PUT /identity/v3/projects/c77d527ae2de476293b320de58bb5c4a/users/ca0393726c924c18b1adb561a317b72d/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:57.456500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07390-2bd6-44e1-901d-be497c4d9471 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.456824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07390-2bd6-44e1-901d-be497c4d9471 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.460356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07390-2bd6-44e1-901d-be497c4d9471 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.464816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 811/1632] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 20 13:46:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:46:57.465628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07390-2bd6-44e1-901d-be497c4d9471 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.556941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 822/1633] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:57.558528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.558750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.559031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.617280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:57.625074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:57.657504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07390-2bd6-44e1-901d-be497c4d9471 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.669072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.669768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.670061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.672375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.673753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.676415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a8cf5-1976-48cd-bf60-5cde87b0db70 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.706855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 812/1634] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:46:57.709162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b199d-81b5-4041-afdd-b10955c30bab None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.710997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b199d-81b5-4041-afdd-b10955c30bab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.711384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b199d-81b5-4041-afdd-b10955c30bab None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.717996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 813/1635] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 20 13:46:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:46:57.718933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b199d-81b5-4041-afdd-b10955c30bab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.770590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 823/1636] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:57.771467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:57.809249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d3066-c2bb-4bd0-b6e7-aba0d463c4d4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.823959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.824161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.824425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.824690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] PATH_INFO: `/v3/projects/c77d527ae2de476293b320de58bb5c4a/users/ca0393726c924c18b1adb561a317b72d/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.831016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d527ae2de476293b320de58bb5c4a, user_id=ca0393726c924c18b1adb561a317b72d, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:57.837388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5d47b-a665-458e-b06a-7292b8917e1c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:57.862843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 824/1637] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:46:57 2022] PUT /identity/v3/projects/c77d527ae2de476293b320de58bb5c4a/users/ca0393726c924c18b1adb561a317b72d/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:46:57.865199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46583b9-3697-487b-8a0f-4eefa9c109d2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.865488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46583b9-3697-487b-8a0f-4eefa9c109d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.865766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46583b9-3697-487b-8a0f-4eefa9c109d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:57.867757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b199d-81b5-4041-afdd-b10955c30bab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:57.899173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d46583b9-3697-487b-8a0f-4eefa9c109d2 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:57.900636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d46583b9-3697-487b-8a0f-4eefa9c109d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:57.914075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:57.946619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:57.947400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:57.947690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:57.947973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:58.031833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:58.033520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:58.046690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 814/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:58.047640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:58.056977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f30e1-54ad-48ea-9b2b-6ea7ce3f0e3b service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:58.061708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:58.062373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:58.062662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:58.062942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:58.086009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 825/1639] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:58.090437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:58.090766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:58.091066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:58.151027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] MFA Rules not processed for user `ca0393726c924c18b1adb561a317b72d`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:46:58.152981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:46:58.167853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:46:58.175223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:58.179744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:58.194494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 815/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:58.195518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:58.205224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb315cd-16c0-4994-af1a-e869089285f6 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:58.209707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:58.210344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:58.210616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:58.211449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:58.225383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:58.226982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:58.241794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 816/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:58.329156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 826/1642] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:46:59.080953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:59.090768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d8bb-eaf8-44d7-a451-8138fa54d74c service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:59.103861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:59.104622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:59.104923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:59.105596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:59.126419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:59.130302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:59.156872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 817/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:59.345768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:59.367920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf343a7-22c8-416f-bff9-ff25becbc759 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:59.380707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:59.381408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:59.381703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:59.381989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:46:59.473465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:46:59.478746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862682a9-d204-4eff-b9de-ede5cc1d5246 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:46:59.501930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 827/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:46:59.813863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:46:59.856820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961497-3a25-4d21-878d-08dda289598f service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:46:59.880266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:46:59.883310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:46:59.885615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:46:59.887825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:00.011807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:00.047330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:00.049320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:00.063814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 818/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:05.245122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:05.245619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:05.245619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:05.312379 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] MFA Rules not processed for user `b55c81544d4342fb89dd8dbce3400fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:05.314572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:05.466072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 828/1646] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:05.474514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:05.493419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b31ee-227e-40de-b110-d065b237a513 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:05.518330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:05.519317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:05.519745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:05.520157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:05.557311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:05.563060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:05.594902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 819/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:05.703804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:05.802827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:05.859813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cbc44-ea3c-45cf-9b4c-dd845afc3277 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:05.873867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:05.875538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:05.876001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:05.876356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] PATH_INFO: `/v3/users/624d5f06ae8e432bb967c6ce8956064a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:05.879003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] RBAC: Authorizing `identity:delete_user(user_id=624d5f06ae8e432bb967c6ce8956064a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:05.880056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: WARNING py.warnings [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:47:05.880056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: warnings.warn(msg) Jul 20 13:47:05.880056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: Jul 20 13:47:05.881723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:06.055053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624d5f06ae8e432bb967c6ce8956064a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.055755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624d5f06ae8e432bb967c6ce8956064a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.110096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:06.118185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624d5f06ae8e432bb967c6ce8956064a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.131452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47692db-d9dc-426d-a92c-61d2beecec31 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:06.141410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:06.142818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:06.143476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:06.145022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] PATH_INFO: `/v3/users/baa6d72bd62f403095f8c6ba1c93f023` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:06.147891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa6d72bd62f403095f8c6ba1c93f023)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:06.152769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:06.157257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624d5f06ae8e432bb967c6ce8956064a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.177092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56ba98ce-f7d0-44e9-abc5-b41c7dcc783b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624d5f06ae8e432bb967c6ce8956064a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.184180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 829/1648] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:05 2022] DELETE /identity/v3/users/624d5f06ae8e432bb967c6ce8956064a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:06.188477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:06.188848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:06.189202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:06.231057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:06.233667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:06.307583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa6d72bd62f403095f8c6ba1c93f023'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.352781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa6d72bd62f403095f8c6ba1c93f023'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.381696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa6d72bd62f403095f8c6ba1c93f023'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.403925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa6d72bd62f403095f8c6ba1c93f023'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.405191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00da4740-b750-4eec-8a8a-6fdf263a7179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa6d72bd62f403095f8c6ba1c93f023'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:06.436778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 820/1649] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:06 2022] DELETE /identity/v3/users/baa6d72bd62f403095f8c6ba1c93f023 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:06.440387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:06.440684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:06.440970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:06.456090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 830/1650] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:06.470890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:06.472486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:06.476585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:06.479168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:06.595889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b54a-1c04-41f8-ab13-6148249442ba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:06.620230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:06.657062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 821/1651] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:06.674459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:06.678235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:06.736116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:06.739935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:06.741397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:06.741913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:06.777417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:06.781859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:06.813587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 831/1652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:06.821169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:06.888109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cc49c-48cd-4aaf-8aee-8e5af9c50e99 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:06.899567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:06.901471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:06.901882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:06.902558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:06.936949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:06.942259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751636bf-958f-4d8a-b346-b17630a050a9 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:06.996013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 822/1653] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:07.698984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:07.700611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:07.721566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a399b-03ac-4dce-98b2-d7c7ae8da658 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:07.736716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:07.739679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:07.740639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:07.741330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] PATH_INFO: `/v3/projects/ba279ef34ec4419e9438f5e6811c3ce1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:07.743921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba279ef34ec4419e9438f5e6811c3ce1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:07.750750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:07.875494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba279ef34ec4419e9438f5e6811c3ce1', 'request_id': 'req-d5a3524e-2981-46f1-b1ec-606d40ae87e3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:07.889955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba279ef34ec4419e9438f5e6811c3ce1', 'request_id': 'req-d5a3524e-2981-46f1-b1ec-606d40ae87e3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:07.902960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba279ef34ec4419e9438f5e6811c3ce1', 'request_id': 'req-d5a3524e-2981-46f1-b1ec-606d40ae87e3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:07.929290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] The token cache is being invalidate because project ba279ef34ec4419e9438f5e6811c3ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:07.929597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:07.933339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d5a3524e-2981-46f1-b1ec-606d40ae87e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:07.936445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 832/1654] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:07 2022] DELETE /identity/v3/projects/ba279ef34ec4419e9438f5e6811c3ce1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:07.941659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:07.942184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:07.942413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:07.977668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:07.979151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:08.113774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 823/1655] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:08.121432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.121728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.122016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.142153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:08.143388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:08.159422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 833/1656] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:08.160610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.175458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec2f1-1d6e-4793-8d15-b978cd7857ef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.183195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.184329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.184766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.185192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.186817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:08.187424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.189421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.205422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 824/1657] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:08.209614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.220331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488991e-8f12-4b15-b44c-a16e98718ef9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.225319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.225993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.226281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.226561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.227283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.230426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.284651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.284788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 834/1658] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:08 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:08.298734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0faea-e1ac-468e-b372-4a7280abea60 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.374615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.375780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.376347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.376833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.378619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.381317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.416853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.420475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 825/1659] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:08 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:08.433829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3df90-a2c0-4c24-92ff-a19fdf623ca3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.443364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.444617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.445133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.445748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.446916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.449143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.469661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.470772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 835/1660] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:08.483030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c5b0-c85f-4932-93e2-db0bb32318d7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.488693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.489723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.490342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.491101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.492057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.494014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca128e-336a-4223-9d05-4ff72cf5ecd4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.512611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.525700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 826/1661] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:08.528226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491737-a956-4f92-9250-12419632d8fb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.536001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.538029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.538306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.538594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] PATH_INFO: `/v3/projects/9d032aed307f4d76a6dba1bb17508451/users/132ba013944b43d48ceb15f5924cf63a/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.559497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d032aed307f4d76a6dba1bb17508451, user_id=132ba013944b43d48ceb15f5924cf63a, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.563020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:08.600625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.602813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.603262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.603720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 836/1662] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:08 2022] PUT /identity/v3/projects/9d032aed307f4d76a6dba1bb17508451/users/132ba013944b43d48ceb15f5924cf63a/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:08.659320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] MFA Rules not processed for user `132ba013944b43d48ceb15f5924cf63a`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:08.680722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:08.758976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:08.810284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 827/1663] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:08.811484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:08.901133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:08.969360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd67f-c408-448d-a320-4c1de39b2f8d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:08.982787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:08.983868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:08.984368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:08.984970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:08.985880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:08.996001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:09.050016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 837/1664] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:08 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:09.055300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:09.125384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ce52-898f-478c-a9f1-21ecb9450784 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:09.198921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:09.201598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:09.386873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:09.387567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:09.387858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:09.388140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:09.400836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:09.415733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:09.487617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914a81-91b5-4ac8-8594-107dafcbea32 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:09.488345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 828/1665] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:09 2022] POST /identity/v3/users => generated 289 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:09.489337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:09.508299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:09.509350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:09.509723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:09.510079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] PATH_INFO: `/v3/projects/18451dd39acd47df869fe875bc2dae66` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:09.512279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18451dd39acd47df869fe875bc2dae66)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:09.514961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:09.521701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702287-3c65-4cb1-9dbf-3dc5885b03cb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:09.538951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:09.539651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:09.539947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:09.540397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:09.541158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:09.542851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:09.575174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 829/1666] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:09.585677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:09.617520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911690ce-b196-4f1e-91db-c7df27e533fb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:09.675830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18451dd39acd47df869fe875bc2dae66', 'request_id': 'req-3e1af02d-b9d9-4d82-b014-162e3b54aa18'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:09.686419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18451dd39acd47df869fe875bc2dae66', 'request_id': 'req-3e1af02d-b9d9-4d82-b014-162e3b54aa18'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:09.699459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18451dd39acd47df869fe875bc2dae66', 'request_id': 'req-3e1af02d-b9d9-4d82-b014-162e3b54aa18'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:09.733220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] The token cache is being invalidate because project 18451dd39acd47df869fe875bc2dae66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:09.733526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:09.738296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:09.749619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 838/1667] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:09 2022] DELETE /identity/v3/projects/18451dd39acd47df869fe875bc2dae66 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:09.753776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:09.769108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:09.845524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:09.846832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:09.847354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:09.847856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] PATH_INFO: `/v3/projects/d8152110f11c481c8c674c60bee0c1ee/users/b34c0489ec804a6c927d3949272e1d97/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:09.922967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8152110f11c481c8c674c60bee0c1ee, user_id=b34c0489ec804a6c927d3949272e1d97, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:09.930170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570fc57-209d-431c-ba82-8a9431cf5950 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:09.960952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:09.985459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 830/1668] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:09 2022] PUT /identity/v3/projects/d8152110f11c481c8c674c60bee0c1ee/users/b34c0489ec804a6c927d3949272e1d97/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:09.989440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:09.989440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:09.993514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:10.007505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af02d-b9d9-4d82-b014-162e3b54aa18 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:10.089292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] MFA Rules not processed for user `7c1d0edb03914ac69ebdb833ee1c2d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:10.093672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:10.152588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:10.297954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 831/1669] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:10.299795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:10.302931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:10.367203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:10.375292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:10.378506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:10.378811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] PATH_INFO: `/v3/users/ca0393726c924c18b1adb561a317b72d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:10.381660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0393726c924c18b1adb561a317b72d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:10.383669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:10.599649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28040cb3-4485-42ed-bd09-1be301be741b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:10.625054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:10.627448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0393726c924c18b1adb561a317b72d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:10.629247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:10.629442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0393726c924c18b1adb561a317b72d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:10.639434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:10.641553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:10.642744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:10.660786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0393726c924c18b1adb561a317b72d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:10.661005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba1d2-338c-4629-9d2c-99228573211d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:10.690971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0393726c924c18b1adb561a317b72d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:10.704667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0393726c924c18b1adb561a317b72d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:10.707790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 832/1670] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:10.715709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:10.716010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:10.719054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:10.721655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 839/1671] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:09 2022] DELETE /identity/v3/users/ca0393726c924c18b1adb561a317b72d => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:10.722562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:10.724013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:10.793284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] MFA Rules not processed for user `7c1d0edb03914ac69ebdb833ee1c2d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:10.794785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:10.930403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727198-bfdc-4822-b0d4-2838f41753ed admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:10.937640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:10.948345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:10.948888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:10.950004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] PATH_INFO: `/v3/users/f23c790443054398a773f19508158509` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:10.952247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23c790443054398a773f19508158509)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:10.956765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:10.984832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 833/1672] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:10.988954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:10.989035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:10.995098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.049394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6464-2347-4732-b1e9-7e6c488620f6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:11.054471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23c790443054398a773f19508158509'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:11.055438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23c790443054398a773f19508158509'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:11.069208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23c790443054398a773f19508158509'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:11.077715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:11.079065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:11.079356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:11.079637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] PATH_INFO: `/v3/projects/d8152110f11c481c8c674c60bee0c1ee/users/b34c0489ec804a6c927d3949272e1d97/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:11.087956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8152110f11c481c8c674c60bee0c1ee, user_id=b34c0489ec804a6c927d3949272e1d97, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:11.095848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de0c1-7ef6-4a78-83bc-52c3e6726862 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:11.103423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23c790443054398a773f19508158509'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:11.132323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23c790443054398a773f19508158509'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:11.143195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 840/1673] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:10 2022] DELETE /identity/v3/users/f23c790443054398a773f19508158509 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:11.143195 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:11.157944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 834/1674] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:10 2022] PUT /identity/v3/projects/d8152110f11c481c8c674c60bee0c1ee/users/b34c0489ec804a6c927d3949272e1d97/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:11.162175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.162981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c57af-7816-475d-a85a-1ceb8ebe0cb5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:11.165728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c57af-7816-475d-a85a-1ceb8ebe0cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:11.166027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c57af-7816-475d-a85a-1ceb8ebe0cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:11.222964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-117c57af-7816-475d-a85a-1ceb8ebe0cb5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:11.224340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-117c57af-7816-475d-a85a-1ceb8ebe0cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.376410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee96c1-bc8d-4130-9ddd-e13961b8f441 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:11.393650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:11.394667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:11.395099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:11.395499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:11.401357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.401551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:11.497217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 835/1675] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:11.497217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3318a-9de9-45fd-b44a-58a49203e4dd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:11.497217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3318a-9de9-45fd-b44a-58a49203e4dd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:11.497217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3318a-9de9-45fd-b44a-58a49203e4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:11.609494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c7c3318a-9de9-45fd-b44a-58a49203e4dd None None] MFA Rules not processed for user `b34c0489ec804a6c927d3949272e1d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:11.614758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c7c3318a-9de9-45fd-b44a-58a49203e4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.705087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:11.714351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:11.777828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 841/1676] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:11.780634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:11.786994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.886517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 836/1677] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:11.889910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:11.890451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:11.890935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:11.923191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] MFA Rules not processed for user `b55c81544d4342fb89dd8dbce3400fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:11.925973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:11.926669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:12.025363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c026-0c7d-4b2a-ba0e-ee97f6aefe45 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:12.036321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:12.042532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.042814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.043105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:12.062029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:12.064210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:12.078528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 842/1678] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:12.079906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:12.084437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:12.129718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 837/1679] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:12.295925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564b17-f508-45ed-b546-e6bdf2570088 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:12.307884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:12.308754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.308946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.309230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:12.356081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:12.358165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08557478-c0ce-4086-a646-5ec4a46f88db service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:12.400316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 843/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:12.514555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:12.531691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba5cf-2ec7-4f4d-baa2-5f0a9693f4a1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:12.538714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:12.539658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.540096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.540564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:12.542873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:12.683796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:12.685446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b91cf9-b6dd-43e7-b45d-ade1935037af service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:12.710143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 838/1681] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:12.968707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f394b4-0e3d-49bc-89ff-417be5cf584c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.969610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f394b4-0e3d-49bc-89ff-417be5cf584c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.970159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f394b4-0e3d-49bc-89ff-417be5cf584c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:12.973677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 844/1682] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 20 13:47:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:12.980703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.981342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.982257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:12.998622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:12.998991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:12.999185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.051373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:13.053219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] MFA Rules not processed for user `f9cb52fe271348c1bc0ffda92063bf59`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:13.054860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.062009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:13.063436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.079835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 839/1683] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:13.088230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:13.120163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7720e-66c2-4b0d-be7b-aa87bafbd775 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:13.124826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:13.125873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:13.126617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:13.127434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.137308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:13.141623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:13.153155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 840/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:13.195368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 845/1685] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:13.455045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:13.456828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.475011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ce9e-3289-49ab-a87f-37714ab36401 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:13.482685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:13.483818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:13.484337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:13.484745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] PATH_INFO: `/v3/users/fb0a981a9f544089a2c53a23cd93a38f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.486394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0a981a9f544089a2c53a23cd93a38f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:13.488857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:13.601179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0a981a9f544089a2c53a23cd93a38f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.608523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:13.609951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.616273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0a981a9f544089a2c53a23cd93a38f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.625161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0a981a9f544089a2c53a23cd93a38f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.638715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115439b2-f4e6-41b5-a091-0a0686442dda None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:13.642081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0a981a9f544089a2c53a23cd93a38f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.642978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9d5e918d-dc72-4467-b5ae-1e8c860debe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0a981a9f544089a2c53a23cd93a38f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.650289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:13.653225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:13.654165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:13.656361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] PATH_INFO: `/v3/projects/c77d527ae2de476293b320de58bb5c4a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.658834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77d527ae2de476293b320de58bb5c4a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:13.661827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 841/1686] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:13 2022] DELETE /identity/v3/users/fb0a981a9f544089a2c53a23cd93a38f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:13.664323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:13.665976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:13.666379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:13.666765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.688980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:13.690784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.768899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77d527ae2de476293b320de58bb5c4a', 'request_id': 'req-64f85fa1-80f5-42ef-b608-f14435b5f456'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.788568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77d527ae2de476293b320de58bb5c4a', 'request_id': 'req-64f85fa1-80f5-42ef-b608-f14435b5f456'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.800374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:13.804446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 842/1687] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:13.804571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77d527ae2de476293b320de58bb5c4a', 'request_id': 'req-64f85fa1-80f5-42ef-b608-f14435b5f456'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.808407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:13.811346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.834005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] The token cache is being invalidate because project c77d527ae2de476293b320de58bb5c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:13.834005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.834005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:13.834005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 846/1688] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:13 2022] DELETE /identity/v3/projects/c77d527ae2de476293b320de58bb5c4a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:13.834570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:13.838901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:13.839191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a52102-f791-40b8-b690-d002346b7b9b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:13.945401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:13.946523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:13.946887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:13.947302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] PATH_INFO: `/v3/projects/4d7333e4bd914d24bf1a05e10d7bd7a1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:13.949144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7333e4bd914d24bf1a05e10d7bd7a1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:13.950822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: WARNING py.warnings [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 13:47:13.950822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: warnings.warn(msg) Jul 20 13:47:13.950822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: Jul 20 13:47:13.952560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:13.954686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:13.997486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85fa1-80f5-42ef-b608-f14435b5f456 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:14.007769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:14.008861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.009367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.009959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.013189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.038517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7333e4bd914d24bf1a05e10d7bd7a1', 'request_id': 'req-14bc66b6-b673-4138-ab64-01009967d498'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:14.047555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7333e4bd914d24bf1a05e10d7bd7a1', 'request_id': 'req-14bc66b6-b673-4138-ab64-01009967d498'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:14.066276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7333e4bd914d24bf1a05e10d7bd7a1', 'request_id': 'req-14bc66b6-b673-4138-ab64-01009967d498'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:14.114871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] The token cache is being invalidate because project 4d7333e4bd914d24bf1a05e10d7bd7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:14.115181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:14.115865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:14.118668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc87848-1849-4b7e-8fb8-860139262d52 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:14.119859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-14bc66b6-b673-4138-ab64-01009967d498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:14.126949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 843/1689] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:13 2022] DELETE /identity/v3/projects/4d7333e4bd914d24bf1a05e10d7bd7a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:14.126949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.126949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.126949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.129755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 844/1690] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 20 13:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:14.130789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:14.131949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 847/1691] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:14.133504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70799-164e-4fa6-bbc3-b9d6ba5fe54e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.134061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70799-164e-4fa6-bbc3-b9d6ba5fe54e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.134333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.134450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70799-164e-4fa6-bbc3-b9d6ba5fe54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.177114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9ee70799-164e-4fa6-bbc3-b9d6ba5fe54e None None] MFA Rules not processed for user `419fced725134a31bee9907051f2621b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.186927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9ee70799-164e-4fa6-bbc3-b9d6ba5fe54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.264841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cb0b4-f94f-4875-a177-a7e6e2ae85d8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:14.272481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:14.273809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.274136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.274426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.277326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.341884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 848/1692] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.345356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3dbb7-1924-49b8-bac8-89169c65660a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.345818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3dbb7-1924-49b8-bac8-89169c65660a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.346187 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3dbb7-1924-49b8-bac8-89169c65660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.393710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e1b3dbb7-1924-49b8-bac8-89169c65660a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.395174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1b3dbb7-1924-49b8-bac8-89169c65660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.412693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:14.448008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:14.449688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450efe8-c14c-4f14-94df-96b3179eebd7 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:14.511396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 845/1693] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:14.513067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b8b2-6b45-400c-9859-a7208f3256f2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.513516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b8b2-6b45-400c-9859-a7208f3256f2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.514462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b8b2-6b45-400c-9859-a7208f3256f2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.516301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 846/1694] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 20 13:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:14.517557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2345-e446-4841-94a4-1e464c1e6d4b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.518085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2345-e446-4841-94a4-1e464c1e6d4b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.518438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2345-e446-4841-94a4-1e464c1e6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.551123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-27ec2345-e446-4841-94a4-1e464c1e6d4b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.553366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-27ec2345-e446-4841-94a4-1e464c1e6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.572298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 847/1695] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.572298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1267e-cb01-4eb7-ade4-ef6fe45484cf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.575053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1267e-cb01-4eb7-ade4-ef6fe45484cf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.575284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1267e-cb01-4eb7-ade4-ef6fe45484cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.603951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 849/1696] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.606705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63dd2-dc83-4817-b8a9-51c50071f115 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.607206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63dd2-dc83-4817-b8a9-51c50071f115 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.608167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63dd2-dc83-4817-b8a9-51c50071f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.622514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6ff1267e-cb01-4eb7-ade4-ef6fe45484cf None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.630817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6ff1267e-cb01-4eb7-ade4-ef6fe45484cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.643213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fbb63dd2-dc83-4817-b8a9-51c50071f115 None None] MFA Rules not processed for user `419fced725134a31bee9907051f2621b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.644988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 848/1697] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.646669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225182cb-4834-48ef-99e5-0a0cf5fd93eb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.647100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225182cb-4834-48ef-99e5-0a0cf5fd93eb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.647488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225182cb-4834-48ef-99e5-0a0cf5fd93eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.654064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fbb63dd2-dc83-4817-b8a9-51c50071f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.663334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 850/1698] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.669732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75978ed-f87c-4807-8171-7f1361a18438 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.671128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75978ed-f87c-4807-8171-7f1361a18438 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.672415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75978ed-f87c-4807-8171-7f1361a18438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.699547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e75978ed-f87c-4807-8171-7f1361a18438 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.701145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e75978ed-f87c-4807-8171-7f1361a18438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.706968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-225182cb-4834-48ef-99e5-0a0cf5fd93eb None None] MFA Rules not processed for user `7c1d0edb03914ac69ebdb833ee1c2d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.708871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-225182cb-4834-48ef-99e5-0a0cf5fd93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.750653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:14.812321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 851/1699] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.814256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.814786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.815378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.823314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 849/1700] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.824922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.827032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.827771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.852799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.854412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.862526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:14.869339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 852/1701] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.869541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.869643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:14.869954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:14.900989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 850/1702] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:14.902871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:14.919160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf69c-7caa-4505-8507-47b71fecd49a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:14.929859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:14.931193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:14.931597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:14.931965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:14.957703 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:14.963320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:14.975901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 851/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:14.977107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:14.992789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f31e-ea61-4b8f-8d47-45f64dcadaa9 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.005939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.007455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.007806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.008230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.011099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:15.044361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d568f-83c5-46d6-86ca-d0f9021ba7e4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.059183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.061829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.065452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.066320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.066616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.066899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.075136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 852/1704] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:15.076944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.089515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b013c2-cffe-4369-b0d9-ee68dbf978e2 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.095749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.098054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.104301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.105824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.106602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.107081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.108387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 853/1705] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:15.108688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:15.109187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.111522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.128623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.143638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 853/1706] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:15.145207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.163265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf63f1-f954-4740-a608-7e3941fb985e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.170803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.171897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.172519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.175713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.177325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.181013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84524-01ec-4316-8b23-f2d09b013d4f service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.181321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.219315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.224823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.226100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.226453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 854/1707] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:15 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:15.227206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.228630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.229041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:15.230437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.235226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.302408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 854/1708] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:15.305704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.331373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921512-4b6c-4828-bf86-aadd3ea42150 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.349092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:15.425456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683754-66f9-4737-a357-1183ddcd519d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.442084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.442888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.443070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.443358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.444069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.446066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.465677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.467370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.467370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.467672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.468283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.473754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.485325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 855/1709] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:15 2022] POST /identity/v3/users => generated 284 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:15.489562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.510224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae230-bf3a-4c2d-ad31-e79dc372cb6f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.521573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.523530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.523992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.525276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.527116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.534586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.556603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 855/1710] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:15 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:15.566789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.590957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 856/1711] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:15.594717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.604790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:15.638443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d8a4f-10eb-4b01-a639-20ce946555fa admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.775042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce36c6-3ec2-46d2-9724-20d16759aaaf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.793938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:15.807922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.808667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.808952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.818701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.820607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.823111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.829944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.830877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.831113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.831396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] PATH_INFO: `/v3/projects/e90a23f25e0643ba933d1ca23b213ccd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.834799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90a23f25e0643ba933d1ca23b213ccd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.839389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:15.905696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 856/1712] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:15 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:15.913617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:15.953020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc743f9-9c36-4185-81f2-f1ff3a173974 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:15.989975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:15.990884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:15.992102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:15.992646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:15.993655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:15.995506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:16.023856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90a23f25e0643ba933d1ca23b213ccd', 'request_id': 'req-621add14-2b4a-4b6d-8758-48e4c82a7c06'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.043612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 857/1713] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:16.045316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.047681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90a23f25e0643ba933d1ca23b213ccd', 'request_id': 'req-621add14-2b4a-4b6d-8758-48e4c82a7c06'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.064314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90a23f25e0643ba933d1ca23b213ccd', 'request_id': 'req-621add14-2b4a-4b6d-8758-48e4c82a7c06'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.067307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb232f-29b8-4bfd-a475-b0bd994f341e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:16.117930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] The token cache is being invalidate because project e90a23f25e0643ba933d1ca23b213ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:16.118249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.124383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.131498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 857/1714] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:15 2022] DELETE /identity/v3/projects/e90a23f25e0643ba933d1ca23b213ccd => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:16.134664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.145133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:16.187093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:16.188591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.189618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.191826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:16.193137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:16.202527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:16.255531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 858/1715] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:16.257361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.259808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:16.277638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5c29-4e73-4d57-879a-6ce90a8331d8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:16.288414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:16.289744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.290245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.290744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] PATH_INFO: `/v3/users/d9e7a4938c2249d797af668f073e43ad` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:16.292284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e7a4938c2249d797af668f073e43ad)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:16.294842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:16.300879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:16.437516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621add14-2b4a-4b6d-8758-48e4c82a7c06 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:16.439275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e7a4938c2249d797af668f073e43ad'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.442189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e7a4938c2249d797af668f073e43ad'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.464496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:16.465412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.465832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.466048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] PATH_INFO: `/v3/projects/5c04e72d367542c5b683d88d3f512552/users/3341a757761c43e8be69c746a000eb4a/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:16.469414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e7a4938c2249d797af668f073e43ad'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.513610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e7a4938c2249d797af668f073e43ad'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.517118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c04e72d367542c5b683d88d3f512552, user_id=3341a757761c43e8be69c746a000eb4a, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:16.519880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:16.537278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f743df53-6da3-4943-a9fb-e8f714f67bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e7a4938c2249d797af668f073e43ad'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:16.552149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 858/1716] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:16 2022] PUT /identity/v3/projects/5c04e72d367542c5b683d88d3f512552/users/3341a757761c43e8be69c746a000eb4a/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:16.553033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.557540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:16.561811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 859/1717] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:16 2022] DELETE /identity/v3/users/d9e7a4938c2249d797af668f073e43ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:16.566628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.567206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.568034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:16.691166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:16.703727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df799-f82f-40e7-9021-27c6996654b4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:16.725061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] MFA Rules not processed for user `3341a757761c43e8be69c746a000eb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:16.733879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:16.893729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:16.894599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.894968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.895440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:16.896340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:16.899223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:16.917102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 859/1718] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:16.921056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.946969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 860/1719] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:16.958640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:16.960516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:16.964369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e0f1-8968-48af-92a1-db55ca258eec admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:16.988717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:16.989643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:16.990004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:16.990348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] PATH_INFO: `/v3/projects/f62189ffe4d94465a62868a9a1817e74/users/92bbcf614a854f80975d6254848c948b/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:17.054603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62189ffe4d94465a62868a9a1817e74, user_id=92bbcf614a854f80975d6254848c948b, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:17.065762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d97141-2b94-4590-8b77-5791e6f220e7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:17.116380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 860/1720] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:16 2022] PUT /identity/v3/projects/f62189ffe4d94465a62868a9a1817e74/users/92bbcf614a854f80975d6254848c948b/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:17.129127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:17.129424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:17.129709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:17.197943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d45e7-b7c9-4f54-868c-2a3909f41a60 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:17.224437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] MFA Rules not processed for user `92bbcf614a854f80975d6254848c948b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:17.228536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:17.304417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:17.398298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:17.399073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:17.399367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:17.400790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:17.493159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 861/1721] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:17.494279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:17.640819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:17.640819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:17.685317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 861/1722] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:17.733068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a783e8-fcea-4c2b-abbb-a8617f2bee3c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:17.742656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:17.743402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:17.743698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:17.743981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:17.745636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:17.751816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:17.779449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:17.830171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 862/1723] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:17 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:17.833682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:17.909344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff148-8421-47f2-a962-62fa1f6d3874 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:18.114889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:18.116707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:18.265887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:18.266479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:18.266767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:18.267054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:18.267767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:18.269766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:18.365749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 862/1724] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:17 2022] POST /identity/v3/users => generated 299 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:18.366728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:18.394990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384508-d630-4282-9641-4a5e2bea80d6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:18.403206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27f4b0-88df-437d-9d63-ec515e1f1f02 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:18.413202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:18.414571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:18.415268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:18.415561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:18.415843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:18.420463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:18.420759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:18.421039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] PATH_INFO: `/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:18.422440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:18.424881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb12b8e691d5478ea1f54b29a4d3816f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:18.426833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:18.430482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:18.489568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 863/1725] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:18.495838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:18.538710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d2c7-5a4a-46fa-a277-c1699aed796a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:18.561769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:18.566516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:18.570236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:18.571417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] PATH_INFO: `/v3/projects/88656a62ff3741ec843a54214ea2f49a/users/b894beb8be6e4de99388bc5889d4f1db/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:18.665512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88656a62ff3741ec843a54214ea2f49a, user_id=b894beb8be6e4de99388bc5889d4f1db, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:18.668266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:18.680102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb12b8e691d5478ea1f54b29a4d3816f', 'request_id': 'req-8f020cdb-a84e-4445-91b5-a70a23c44371'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:18.711972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb12b8e691d5478ea1f54b29a4d3816f', 'request_id': 'req-8f020cdb-a84e-4445-91b5-a70a23c44371'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:18.738862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb12b8e691d5478ea1f54b29a4d3816f', 'request_id': 'req-8f020cdb-a84e-4445-91b5-a70a23c44371'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:18.742596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 864/1726] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:18 2022] PUT /identity/v3/projects/88656a62ff3741ec843a54214ea2f49a/users/b894beb8be6e4de99388bc5889d4f1db/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:18.747629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:18.779943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] The token cache is being invalidate because project fb12b8e691d5478ea1f54b29a4d3816f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:18.782282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:18.785104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8f020cdb-a84e-4445-91b5-a70a23c44371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:18.788534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 863/1727] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:18 2022] DELETE /identity/v3/projects/fb12b8e691d5478ea1f54b29a4d3816f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:18.794179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47c04-4f68-4225-9fef-f835afe4db40 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:18.794658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47c04-4f68-4225-9fef-f835afe4db40 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:18.795660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47c04-4f68-4225-9fef-f835afe4db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:18.838187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-eab47c04-4f68-4225-9fef-f835afe4db40 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:18.840434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-eab47c04-4f68-4225-9fef-f835afe4db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:18.871488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:18.981363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d05d0-4bfb-45d4-a0d2-71894ddb8b75 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.010299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.011016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.011307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.011590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.016685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.021607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.058903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 865/1728] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:19.064290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.071518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:19.106040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9eb0-cee5-4e8c-95f6-a36a75c5814f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.115324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 864/1729] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:19.125306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.126049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.126595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.126718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.131890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.132203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.132505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] PATH_INFO: `/v3/projects/88656a62ff3741ec843a54214ea2f49a/users/b894beb8be6e4de99388bc5889d4f1db/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.143024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88656a62ff3741ec843a54214ea2f49a, user_id=b894beb8be6e4de99388bc5889d4f1db, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.150575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7b3b-feaf-463d-9642-1b9885fd4d0c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.191724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 866/1730] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:19 2022] PUT /identity/v3/projects/88656a62ff3741ec843a54214ea2f49a/users/b894beb8be6e4de99388bc5889d4f1db/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:19.203885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164620-cde0-40e6-874f-ba9906e55aa6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.204432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164620-cde0-40e6-874f-ba9906e55aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.204890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164620-cde0-40e6-874f-ba9906e55aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.205404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:19.206911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:19.255043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:19.271617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1f164620-cde0-40e6-874f-ba9906e55aa6 None None] MFA Rules not processed for user `b894beb8be6e4de99388bc5889d4f1db`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:19.273483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f164620-cde0-40e6-874f-ba9906e55aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:19.427838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 865/1731] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:19.432360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.453718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e81ff-ea80-41e4-9d6a-02fc95043ba5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.470502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.471365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.471767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.472158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.473081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:19.473524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.475275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.493856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 867/1732] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:19.498431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.498734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.499023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.510545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 866/1733] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:47:19.511619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.515612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:19.528431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] MFA Rules not processed for user `f9cb52fe271348c1bc0ffda92063bf59`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:19.530203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:19.608715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 868/1734] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:19.613808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.658489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbea3-742a-45ab-8ea9-c6ed9944d3bd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.666374 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.667070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.668015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.668408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.669080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.675501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.676853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e909d-6bc4-4cd3-9b27-55d0f3a3c4b9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.690847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.692294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.692586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.692867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.712216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.716174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.736399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 869/1735] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:19 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:19.737963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.744237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 867/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:19.784443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:19.805877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.821367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9c89-3568-4a6f-9e77-a1a18d76b07a service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.844121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33fbe-fd2f-4bde-91cb-c423c3d4ff08 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.849593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.850376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.850881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.851240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.852022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.854101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.892510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 870/1737] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:19 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:19.893546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:19.941830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428821-9970-4447-9f1c-72303fa391e4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:19.957147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.959467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.961155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:19.961639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.962043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.962735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:19.963069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.963464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:19.963891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] PATH_INFO: `/v3/users/92bbcf614a854f80975d6254848c948b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:19.966123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:19.966913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bbcf614a854f80975d6254848c948b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:19.973144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:20.003885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 871/1738] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:20.006497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:20.025506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640ae1d-65d8-4a8b-8dcd-5c897b43c3ab admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:20.050405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:20.051474 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.052480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.053968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.056622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:20.072837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:20.104370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bbcf614a854f80975d6254848c948b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:20.108701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 872/1739] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:20.117941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:20.123999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:20.147085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bbcf614a854f80975d6254848c948b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:20.147315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeecdcb-fe5d-487b-9595-3528c5843366 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:20.172402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:20.173450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.173742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.177056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] PATH_INFO: `/v3/projects/132b930b755f42bab71ddc2f6338e64c/users/cee6ca296763478394d65b46b2bbb872/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.181326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bbcf614a854f80975d6254848c948b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:20.192839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bbcf614a854f80975d6254848c948b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:20.193731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a02c6372-1f70-4b3b-b321-c88af277ab31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bbcf614a854f80975d6254848c948b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:20.212818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 868/1740] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:19 2022] DELETE /identity/v3/users/92bbcf614a854f80975d6254848c948b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:20.219087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.221826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.222138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.268801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:20.270137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:20.274628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=132b930b755f42bab71ddc2f6338e64c, user_id=cee6ca296763478394d65b46b2bbb872, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:20.286328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300918-c366-4661-881c-7100abcfac3e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:20.320263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 873/1741] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:20 2022] PUT /identity/v3/projects/132b930b755f42bab71ddc2f6338e64c/users/cee6ca296763478394d65b46b2bbb872/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:20.330213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.330750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.331183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.390992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] MFA Rules not processed for user `cee6ca296763478394d65b46b2bbb872`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:20.394415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:20.469945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 869/1742] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:20.484608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:20.486106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:20.582069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 874/1743] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:20.583747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:20.585901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:20.613191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b22ec-c39e-4ff6-a0ab-8d3b91102c5d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:20.707706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:20.708413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.708704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.708987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.712097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cf4b4-0801-4395-a624-de1d82be79e2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:20.719159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:20.721028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:20.721601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:20.721891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:20.722551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:20.722676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:20.724778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:20.725003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:20.733399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:20.753342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 870/1744] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:20.795228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:20.795741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 875/1745] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:20 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:20.809528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95be09-8745-42d9-98f2-fa91802eb57f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:20.993907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:21.098955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:21.100284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.100713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.101104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:21.101950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:21.104918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:21.169779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:21.180766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 871/1746] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:20 2022] POST /identity/v3/users => generated 297 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:21.183430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7891-8930-44f9-992a-db597973f3f5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:21.198193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:21.201856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.202386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.202887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:21.204591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:21.210564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:21.234518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 876/1747] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:21.238339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:21.254726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc1a3-d989-41fe-ade5-b48991b5e1e4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:21.268587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:21.269747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.271318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.271726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] PATH_INFO: `/v3/projects/c96c025efb5c489c886a742524efc48e/users/9084da577e704d08a37e3c69942ce194/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:21.326546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c025efb5c489c886a742524efc48e, user_id=9084da577e704d08a37e3c69942ce194, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:21.330860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:21.389985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 872/1748] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:21 2022] PUT /identity/v3/projects/c96c025efb5c489c886a742524efc48e/users/9084da577e704d08a37e3c69942ce194/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:21.391779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:21.433186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611543eb-bcf6-4ee8-8400-b4bb346091df admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:21.711252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:21.718286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.720589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.720894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:21.724264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:21.725966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9bf5-99f1-458c-a450-3a880ee595e0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:21.792129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 877/1749] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:21.806939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:21.844385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f274b9-b66c-42e3-937f-e5ad1e251f00 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:21.867203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:21.876084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.876409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.876702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] PATH_INFO: `/v3/projects/c96c025efb5c489c886a742524efc48e/users/9084da577e704d08a37e3c69942ce194/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:21.885296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c025efb5c489c886a742524efc48e, user_id=9084da577e704d08a37e3c69942ce194, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:21.891417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:21.933707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 873/1750] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:21 2022] PUT /identity/v3/projects/c96c025efb5c489c886a742524efc48e/users/9084da577e704d08a37e3c69942ce194/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:21.946355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:21.946880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:21.947337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:22.018706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] MFA Rules not processed for user `9084da577e704d08a37e3c69942ce194`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:22.020265 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:22.219319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 878/1751] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:22.237431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:22.240730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:22.287577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:22.290301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:22.575290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fd6f0-e9e0-4978-a169-87c5ee657e0f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:22.586847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8a871-4303-4ee8-8f78-7ede7fb175ce admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:22.592482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:22.610516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:22.611698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:22.612140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:22.612606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] PATH_INFO: `/v3/projects/f62189ffe4d94465a62868a9a1817e74` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:22.614436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62189ffe4d94465a62868a9a1817e74)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:22.616839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:22.618152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:22.618563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:22.618861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:22.676578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:22.682446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561f24-9a37-48a5-b9c1-d46ccb8bd85f service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:22.711045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:22.744127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 879/1752] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:22.746157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:22.763963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:22.765002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:22.830647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62189ffe4d94465a62868a9a1817e74', 'request_id': 'req-0c713a38-5016-45ce-83a1-660d35cf3f74'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:22.858146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62189ffe4d94465a62868a9a1817e74', 'request_id': 'req-0c713a38-5016-45ce-83a1-660d35cf3f74'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:22.896796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62189ffe4d94465a62868a9a1817e74', 'request_id': 'req-0c713a38-5016-45ce-83a1-660d35cf3f74'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:22.940007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] The token cache is being invalidate because project f62189ffe4d94465a62868a9a1817e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:22.942214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:22.943339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:22.944521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:22.946246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:22.948591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 874/1753] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:22 2022] DELETE /identity/v3/projects/f62189ffe4d94465a62868a9a1817e74 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:22.952424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:22.956045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:23.015224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:23.138216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a38-5016-45ce-83a1-660d35cf3f74 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:23.154822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:23.155839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:23.156021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:23.156298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] PATH_INFO: `/v3/users/b894beb8be6e4de99388bc5889d4f1db` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:23.161073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b894beb8be6e4de99388bc5889d4f1db)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:23.163088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:23.173156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 880/1754] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:23.267181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b894beb8be6e4de99388bc5889d4f1db'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:23.295709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b894beb8be6e4de99388bc5889d4f1db'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:23.316829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b894beb8be6e4de99388bc5889d4f1db'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:23.336804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b894beb8be6e4de99388bc5889d4f1db'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:23.337734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b894beb8be6e4de99388bc5889d4f1db'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:23.354603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 875/1755] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:22 2022] DELETE /identity/v3/users/b894beb8be6e4de99388bc5889d4f1db => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:23.514501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:23.521964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:23.643818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:23.646077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:23.844881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797dd32-eda2-4131-8ef0-31c67078289b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:23.860060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9084da577e704d08a37e3c69942ce194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c96c025efb5c489c886a742524efc48e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:23.860792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:23.861079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:23.861417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:23.863160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971984e2-e8ed-46d5-ad07-59443858a17b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:23.866611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:23.866959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:23.870694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:23.908119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 876/1756] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:47:23.909388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:23.931137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64a7c-830b-4181-9c24-c7dc3a5dec28 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:23.946211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9084da577e704d08a37e3c69942ce194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c96c025efb5c489c886a742524efc48e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:23.947033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:23.947469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:23.948323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:23.949810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:23.955208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:24.034717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 877/1757] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:23 2022] POST /identity/v3/projects => generated 355 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:24.035226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:24.035814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:24.048829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:24.073592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:24.074291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:24.074590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:24.074883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:24.085081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:24.265400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f777efd-105a-4b99-b9ea-665258db932a tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:24.271765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:24.274958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:24.277618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9084da577e704d08a37e3c69942ce194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c96c025efb5c489c886a742524efc48e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:24.278900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:24.279960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:24.281094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:24.282072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:24.282556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:24.284599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:24.302832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 881/1758] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:47:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:47:24.323661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 878/1759] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:47:24.390774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:24.410251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b3f72-2ca1-44e0-b604-92b38bce79b2 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:24.425043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9084da577e704d08a37e3c69942ce194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c96c025efb5c489c886a742524efc48e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:24.426452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:24.429397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:24.429977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] PATH_INFO: `/v3/projects/4cc9aaa2bfb24b2a9632cc8469a3faf1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:24.431557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4cc9aaa2bfb24b2a9632cc8469a3faf1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:24.438247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:24.570968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:24.575642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:24.586521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc9aaa2bfb24b2a9632cc8469a3faf1', 'request_id': 'req-46c19fc6-0b51-4b03-8362-ef17a02bd172'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:24.614584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc9aaa2bfb24b2a9632cc8469a3faf1', 'request_id': 'req-46c19fc6-0b51-4b03-8362-ef17a02bd172'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:24.649524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc9aaa2bfb24b2a9632cc8469a3faf1', 'request_id': 'req-46c19fc6-0b51-4b03-8362-ef17a02bd172'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:24.685614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] The token cache is being invalidate because project 4cc9aaa2bfb24b2a9632cc8469a3faf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:24.690857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:24.694805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:24.700143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 882/1760] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:24 2022] DELETE /identity/v3/projects/4cc9aaa2bfb24b2a9632cc8469a3faf1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:24.808645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22da0e-83d8-426a-89f8-3c6239991d77 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:25.037773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:25.039181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.039478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.039766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] PATH_INFO: `/v3/projects/88656a62ff3741ec843a54214ea2f49a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.043180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88656a62ff3741ec843a54214ea2f49a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:25.045341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:25.169298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:25.178331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88656a62ff3741ec843a54214ea2f49a', 'request_id': 'req-3d34ce48-b5a0-4e79-b16e-150b4e170309'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.195835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88656a62ff3741ec843a54214ea2f49a', 'request_id': 'req-3d34ce48-b5a0-4e79-b16e-150b4e170309'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.209010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88656a62ff3741ec843a54214ea2f49a', 'request_id': 'req-3d34ce48-b5a0-4e79-b16e-150b4e170309'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.236479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:25.237961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:25.247670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] The token cache is being invalidate because project 88656a62ff3741ec843a54214ea2f49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:25.247972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.250940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3d34ce48-b5a0-4e79-b16e-150b4e170309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.255549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 879/1761] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:24 2022] DELETE /identity/v3/projects/88656a62ff3741ec843a54214ea2f49a => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:25.262902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236988a-8865-49a2-a9aa-b883e98ae366 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.263257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236988a-8865-49a2-a9aa-b883e98ae366 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.264090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236988a-8865-49a2-a9aa-b883e98ae366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.265646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19fc6-0b51-4b03-8362-ef17a02bd172 tempest-VolumeQuotaClassesTest-1448027558 tempest-VolumeQuotaClassesTest-1448027558-project-admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:25.313706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0236988a-8865-49a2-a9aa-b883e98ae366 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:25.332469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0236988a-8865-49a2-a9aa-b883e98ae366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:25.411642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:25.413874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.414623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.415375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] PATH_INFO: `/v3/users/cee6ca296763478394d65b46b2bbb872` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.417836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee6ca296763478394d65b46b2bbb872)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:25.420846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:25.456481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 880/1762] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:25.466153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.466983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.467743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.479753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:25.553479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:25.555722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee6ca296763478394d65b46b2bbb872'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.556285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:25.557709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee6ca296763478394d65b46b2bbb872'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.573188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee6ca296763478394d65b46b2bbb872'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.596849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 881/1763] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:25.598101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:25.599475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:25.606257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee6ca296763478394d65b46b2bbb872'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.621690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee6ca296763478394d65b46b2bbb872'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:25.637091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 883/1764] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:25 2022] DELETE /identity/v3/users/cee6ca296763478394d65b46b2bbb872 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:25.638520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:25.649349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5f69-a1bb-4409-a2df-1b2eb96a68e8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:25.861845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c95c03-388a-4ed8-a317-6712f3487a20 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:25.877810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:25.878948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.879213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.879687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.880573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:25.880992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:25.885609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dbbc3-9bc1-42dc-bf31-de31c339bcb9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:25.890321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:25.891611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.893213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.893858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] PATH_INFO: `/v3/users/132ba013944b43d48ceb15f5924cf63a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.899335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=132ba013944b43d48ceb15f5924cf63a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:25.908937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:25.930530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 884/1765] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:25.937955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262ccf-8806-454a-8955-220334730498 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:25.938369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262ccf-8806-454a-8955-220334730498 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:25.938622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262ccf-8806-454a-8955-220334730498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:25.977462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2e262ccf-8806-454a-8955-220334730498 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:25.978707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e262ccf-8806-454a-8955-220334730498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:26.004378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 885/1766] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:26.006618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262ccf-8806-454a-8955-220334730498 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:26.037593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262ccf-8806-454a-8955-220334730498 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:26.058444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:26.059487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.059791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.060133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.061305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132ba013944b43d48ceb15f5924cf63a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:26.064275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:26.067011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:26.100541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132ba013944b43d48ceb15f5924cf63a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:26.116611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:26.125422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132ba013944b43d48ceb15f5924cf63a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:26.135329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 886/1767] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:26 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:26.139461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:26.140352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132ba013944b43d48ceb15f5924cf63a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:26.143466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:26.144962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132ba013944b43d48ceb15f5924cf63a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:26.156319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 882/1768] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:25 2022] DELETE /identity/v3/users/132ba013944b43d48ceb15f5924cf63a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:26.157442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:26.159748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:26.371246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe4842-f2bb-4cb8-a067-e94fb6fa37ad admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:26.391998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:26.392745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.393147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.393475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.394323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:26.400026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce225b6-6c2c-4e37-953a-2f615f2b3014 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:26.472872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 883/1769] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:26 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:26.474399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.474836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.475126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.530752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:26.531973 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:26.559194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 884/1770] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:26.559194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:26.578942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1285-b040-4b06-b4fa-d60435b47f98 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:26.595695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb384-2599-42d2-996e-c0d42dd0dc74 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:26.636501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:26.637210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.637497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.637775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.639087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:26.640752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc6d92-9035-474e-aba9-b74fed132bcd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:26.696961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 885/1771] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:26.697709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:26.698773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.699080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.699366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.780370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:26.784346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:26.941321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:26.942404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:26.942890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:26.943395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:26.975779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:27.074713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 886/1772] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 20 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:27.075827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.081069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:27.082614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.093383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.105362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc316e-c3e7-4ecc-a53c-986efcab6a88 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.127018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.128056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.128524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.128956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.170904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 887/1773] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1035 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:27.172957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.174453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.194975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.214417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 887/1774] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:27.215235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.221754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:27.247790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fea1-e459-4209-a265-05a139fbbd8f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.264980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.265658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.265945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.266382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.275317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ca12-e449-484a-95f6-c327cea79293 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.285495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.287157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.287353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.288841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.289317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.289790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.291234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.299860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.301241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 888/1775] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:27.302208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.329348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbd21e-8a61-4b2f-8609-4e17c06a3886 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.344119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 888/1776] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:27.353104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.353514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.354115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.354401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.354681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.381016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.382571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.417541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 889/1777] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:27.421233 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.454694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c183c-bc1e-46ad-bf7f-87785a48f1d7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.469535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d7da8-1978-4c21-ae73-c4841d433510 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.489461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.497368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.498161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.498412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] PATH_INFO: `/v3/projects/145e13712d4b42f4b2430a805fd80ecd/users/d7a5d07f3836464bb170bba1fab8c9a7/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.517758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.518802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.519289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.519768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.553856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145e13712d4b42f4b2430a805fd80ecd, user_id=d7a5d07f3836464bb170bba1fab8c9a7, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.565640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.598077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.608113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9732469-d6dd-410b-925e-3b16bad69aab service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.611299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 890/1778] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:27 2022] PUT /identity/v3/projects/145e13712d4b42f4b2430a805fd80ecd/users/d7a5d07f3836464bb170bba1fab8c9a7/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:27.626952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:27.637655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 889/1779] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:27.645226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.645527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.645948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.646610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:27.803158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] MFA Rules not processed for user `d7a5d07f3836464bb170bba1fab8c9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:27.808304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:27.848897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f045f9-343e-4528-9419-92075cb96c62 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:27.869400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:27.873278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:27.873566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:27.873834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:27.899416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:27.900925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:27.931728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 891/1780] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:28.137260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:28.143400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 890/1781] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:28.293321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c6b1b-81c3-4b40-ba10-68e4cc6c337c service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:28.305530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:28.306223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:28.306566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:28.306783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:28.310841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:28.316246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:28.386381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:28.386814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 892/1782] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:28.418665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea06ae-5e04-4f22-a3b5-05f3e970cdb0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:28.559911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:28.561286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:28.573487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:28.573487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:28.573487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:28.573487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:28.610811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 891/1783] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:28 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:28.615285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:28.641197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db09d0-bc36-4585-8d8e-e43fbad47dbe admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:28.650516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:28.654296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:28.654788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:28.654916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:28.655881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:28.657639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:28.688434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:28.700345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 893/1784] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:28.705681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078a1d7-f011-4a82-93a5-bef491818a19 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:28.724282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:28.733040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:28.735352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:28.735352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] PATH_INFO: `/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa/users/fd405906b8a84cdbac91e626b409545a/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:28.811557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80bb784fdf344c8bbc0cfb728e385fa, user_id=fd405906b8a84cdbac91e626b409545a, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:28.836030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:28.849371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:28.905543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 892/1785] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:28 2022] PUT /identity/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa/users/fd405906b8a84cdbac91e626b409545a/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:28.906046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:28.936132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29072493-5b38-4731-ba7e-4e6304dbcfde admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:29.104526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:29.107129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:29.107677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:29.109057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:29.110445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:29.117013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb213a-0b68-4f04-8083-b3fe81fa8c5a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:29.157763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:29.161451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 894/1786] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:29.170399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8b716-7238-48d0-89c6-577db80d7026 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:29.183485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:29.184434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:29.184780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:29.185163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] PATH_INFO: `/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa/users/fd405906b8a84cdbac91e626b409545a/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:29.190354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80bb784fdf344c8bbc0cfb728e385fa, user_id=fd405906b8a84cdbac91e626b409545a, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:29.193097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:29.233798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 893/1787] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:29 2022] PUT /identity/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa/users/fd405906b8a84cdbac91e626b409545a/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:29.235343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:29.235758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:29.236157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:29.300402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] MFA Rules not processed for user `fd405906b8a84cdbac91e626b409545a`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:29.301985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:29.314544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:29.546051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 895/1788] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:29.557810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:29.560597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:29.785314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0f373-eb48-4a95-a6fa-ad5c404da695 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:29.810240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:29.811298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:29.812428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:29.812946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:29.849911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:29.851616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:29.898923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 894/1789] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:30.044186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:30.063814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e127b1-0630-4770-a3a3-77f6e01d77c2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:30.083115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:30.084142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:30.084624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:30.086369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:30.306422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:30.308701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609a60-a90a-4700-a484-7f90a5da39c9 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:30.335433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 896/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:30.862222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:31.059604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2c873-7f88-4ac6-8b73-e899f770427d service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:31.073445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:31.074356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:31.074640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:31.075139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] PATH_INFO: `/v3/users/d7a5d07f3836464bb170bba1fab8c9a7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:31.083839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a5d07f3836464bb170bba1fab8c9a7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:31.086093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:31.227978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a5d07f3836464bb170bba1fab8c9a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:31.228966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a5d07f3836464bb170bba1fab8c9a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:31.272088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a5d07f3836464bb170bba1fab8c9a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:31.291029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde457-7e03-4368-8f97-2769f9112a5b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:31.291633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde457-7e03-4368-8f97-2769f9112a5b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:31.292073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde457-7e03-4368-8f97-2769f9112a5b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:31.293896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 897/1791] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:31.305322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a5d07f3836464bb170bba1fab8c9a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:31.335553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a5d07f3836464bb170bba1fab8c9a7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:31.358582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 895/1792] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:30 2022] DELETE /identity/v3/users/d7a5d07f3836464bb170bba1fab8c9a7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:31.363168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92e14-ba09-408e-96f4-922bee8ccfd8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:31.363654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92e14-ba09-408e-96f4-922bee8ccfd8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:31.363741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92e14-ba09-408e-96f4-922bee8ccfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:31.406164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cbe92e14-ba09-408e-96f4-922bee8ccfd8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:31.407662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cbe92e14-ba09-408e-96f4-922bee8ccfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:31.436714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:31.438483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:31.448823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:31.746501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 898/1793] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:31.748364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:31.751580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:31.752102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:31.786580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d475-56ec-4414-aa36-3aeb28761729 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:31.816696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:31.817665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:31.818390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:31.823800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] PATH_INFO: `/v3/projects/9d032aed307f4d76a6dba1bb17508451` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:31.828862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:31.829779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d032aed307f4d76a6dba1bb17508451)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:31.831833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:31.841849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:32.003645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:32.018482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d032aed307f4d76a6dba1bb17508451', 'request_id': 'req-aa0d3b6f-be82-4490-be3d-df5392375440'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.028489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d032aed307f4d76a6dba1bb17508451', 'request_id': 'req-aa0d3b6f-be82-4490-be3d-df5392375440'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.038243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d032aed307f4d76a6dba1bb17508451', 'request_id': 'req-aa0d3b6f-be82-4490-be3d-df5392375440'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.067515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] The token cache is being invalidate because project 9d032aed307f4d76a6dba1bb17508451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:32.067828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.069989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.075979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 896/1794] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:31 2022] DELETE /identity/v3/projects/9d032aed307f4d76a6dba1bb17508451 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:32.076960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:32.082813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:32.113638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 899/1795] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:32.114790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:32.118508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:32.160301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ce32-f13d-42fb-bfde-5aa4d440b661 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:32.281049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3b6f-be82-4490-be3d-df5392375440 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:32.293179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:32.294163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:32.298536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:32.300507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:32.307916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:32.400928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:32.406181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:32.410684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:32.412589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] PATH_INFO: `/v3/users/b34c0489ec804a6c927d3949272e1d97` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:32.423247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34c0489ec804a6c927d3949272e1d97)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:32.432984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:32.518502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:32.570641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:32.572458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8fb5a-bb32-4e32-a30b-a6485bb9e5f8 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:32.593962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 897/1796] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:32.597739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a6c-46a3-4e57-8731-edf82264b235 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:32.598146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a6c-46a3-4e57-8731-edf82264b235 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:32.599976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a6c-46a3-4e57-8731-edf82264b235 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:32.602933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 898/1797] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:47:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:32.606060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34c0489ec804a6c927d3949272e1d97'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.649774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34c0489ec804a6c927d3949272e1d97'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.671677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34c0489ec804a6c927d3949272e1d97'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.686949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34c0489ec804a6c927d3949272e1d97'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.687831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34c0489ec804a6c927d3949272e1d97'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:32.702191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 900/1798] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:32 2022] DELETE /identity/v3/users/b34c0489ec804a6c927d3949272e1d97 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:32.756084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:32.756529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:32.756876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:32.789588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:32.791184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:32.900845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 899/1799] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:47:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:33.637522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:33.639615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:33.666702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a6ec5-01f3-49fe-b859-5d0d4c78e050 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:33.674319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:33.675678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:33.676442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:33.676869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:33.679053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:33.694013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:33.695772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:33.720405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 901/1800] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:34.219405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:34.219405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:34.301512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:34.303195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:34.354749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e980-475b-4db8-8be5-3839c3368381 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:34.397164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:34.397792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:34.398080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:34.398368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:34.465781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:34.478901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:34.496847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 902/1801] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:34.500728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:34.515313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:34.570733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62200f3-dbbf-438e-83f3-b50bfc137f05 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:34.601098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:34.607900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:34.612116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:34.612909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] PATH_INFO: `/v3/projects/132b930b755f42bab71ddc2f6338e64c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:34.614383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:34.615798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132b930b755f42bab71ddc2f6338e64c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:34.623667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:34.792290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132b930b755f42bab71ddc2f6338e64c', 'request_id': 'req-c7f51619-fbab-4d77-826e-9aff22ea0638'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:34.797135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe43c9-6eaf-4c6c-80ae-76462d0b3fba service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:34.809465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132b930b755f42bab71ddc2f6338e64c', 'request_id': 'req-c7f51619-fbab-4d77-826e-9aff22ea0638'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:34.824761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132b930b755f42bab71ddc2f6338e64c', 'request_id': 'req-c7f51619-fbab-4d77-826e-9aff22ea0638'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:34.859020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] The token cache is being invalidate because project 132b930b755f42bab71ddc2f6338e64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:34.860102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:34.862116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:34.879607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 900/1802] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:34 2022] DELETE /identity/v3/projects/132b930b755f42bab71ddc2f6338e64c => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:34.885411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:34.890786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:34.915118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:34.989617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:34.991911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:34.992532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:34.993241 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] PATH_INFO: `/v3/projects/145e13712d4b42f4b2430a805fd80ecd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:34.995561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=145e13712d4b42f4b2430a805fd80ecd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:34.999815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:35.114096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f51619-fbab-4d77-826e-9aff22ea0638 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:35.128977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:35.130890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:35.132869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:35.133398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] PATH_INFO: `/v3/users/9084da577e704d08a37e3c69942ce194` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:35.135827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9084da577e704d08a37e3c69942ce194)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:35.141804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:35.196836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145e13712d4b42f4b2430a805fd80ecd', 'request_id': 'req-a7ae8535-3894-4643-b8a8-f2467a23bd8d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.214251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145e13712d4b42f4b2430a805fd80ecd', 'request_id': 'req-a7ae8535-3894-4643-b8a8-f2467a23bd8d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.232297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145e13712d4b42f4b2430a805fd80ecd', 'request_id': 'req-a7ae8535-3894-4643-b8a8-f2467a23bd8d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.250160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9084da577e704d08a37e3c69942ce194'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.251609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9084da577e704d08a37e3c69942ce194'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.261262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] The token cache is being invalidate because project 145e13712d4b42f4b2430a805fd80ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:35.263981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.266626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.272686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9084da577e704d08a37e3c69942ce194'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.277827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 903/1803] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:34 2022] DELETE /identity/v3/projects/145e13712d4b42f4b2430a805fd80ecd => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:35.279061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:35.287166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:35.306434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9084da577e704d08a37e3c69942ce194'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.324048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9084da577e704d08a37e3c69942ce194'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.336529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 901/1804] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:34 2022] DELETE /identity/v3/users/9084da577e704d08a37e3c69942ce194 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:35.359445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:35.361147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:35.477363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8535-3894-4643-b8a8-f2467a23bd8d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:35.500676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:35.521326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681a49f-3a09-4dcb-af7e-cde452a8be9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:35.526914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:35.529918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:35.530072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:35.530410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] PATH_INFO: `/v3/projects/d8152110f11c481c8c674c60bee0c1ee` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:35.531755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8152110f11c481c8c674c60bee0c1ee)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:35.533855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:35.580230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:35.587520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:35.588468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:35.588852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:35.589086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] PATH_INFO: `/v3/users/fd405906b8a84cdbac91e626b409545a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:35.597549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd405906b8a84cdbac91e626b409545a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:35.599680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:35.618966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8152110f11c481c8c674c60bee0c1ee', 'request_id': 'req-6072bf63-b020-459b-991e-993236f586bc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.639623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8152110f11c481c8c674c60bee0c1ee', 'request_id': 'req-6072bf63-b020-459b-991e-993236f586bc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.648920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8152110f11c481c8c674c60bee0c1ee', 'request_id': 'req-6072bf63-b020-459b-991e-993236f586bc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.664603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] The token cache is being invalidate because project d8152110f11c481c8c674c60bee0c1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:35.665270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.667020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6072bf63-b020-459b-991e-993236f586bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.671562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 902/1805] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:35 2022] DELETE /identity/v3/projects/d8152110f11c481c8c674c60bee0c1ee => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:35.692554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:35.695606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:35.696317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:35.726106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd405906b8a84cdbac91e626b409545a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.734427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:35.736312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:35.759393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd405906b8a84cdbac91e626b409545a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.781274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd405906b8a84cdbac91e626b409545a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.798763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd405906b8a84cdbac91e626b409545a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.799448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f18f69a8-db22-496c-8191-f9e1404396bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd405906b8a84cdbac91e626b409545a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:35.818592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 904/1806] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:35 2022] DELETE /identity/v3/users/fd405906b8a84cdbac91e626b409545a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:35.834333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 903/1807] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:35.835418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:35.835713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:35.835994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:35.889478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:35.892682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.016911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 905/1808] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:36.021429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.036927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02f14-d286-44f5-aeab-97fd1b6897ac None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.053119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.053809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.054099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.054380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.055120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:36.055460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.063771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.065144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.068882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.088854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 904/1809] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:36.090467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4d88-7200-449b-b7d3-1aece478c5d9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.097192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.100925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.102493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.104558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.104978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] PATH_INFO: `/v3/users/3341a757761c43e8be69c746a000eb4a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.108228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3341a757761c43e8be69c746a000eb4a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.110329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.127044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce0cc-8ee7-448f-af93-d0cd26e9009b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.140973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.141652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.141943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.142224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.142934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.145290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.172394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:36.218276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 905/1810] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:36 2022] POST /identity/v3/projects => generated 409 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:36.221216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3341a757761c43e8be69c746a000eb4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:36.222373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.288466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3341a757761c43e8be69c746a000eb4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:36.324894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3341a757761c43e8be69c746a000eb4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:36.351359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde240b9-b4e3-43e4-9cc9-cf649d4adb0d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.353223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3341a757761c43e8be69c746a000eb4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:36.354845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-913bb248-0bc1-4d53-87e2-9eba60448dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3341a757761c43e8be69c746a000eb4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:36.359358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.360173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.361260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.362141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.363832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.365358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 906/1811] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:36 2022] DELETE /identity/v3/users/3341a757761c43e8be69c746a000eb4a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:36.366766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.370035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.370339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.370749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.403795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 906/1812] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:36 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:36.405129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.407631 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.425141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5301328-c7cd-41a3-983f-07def7d28bae admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.429140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:36.430571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.438964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:36.547439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.549231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.549837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.550390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.551503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.553511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.563167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 907/1813] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:36.584092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 907/1814] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:36.586595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.600685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef64033-6a47-4d42-a037-42ab6c9a22d4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.610955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.611581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.611963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.612296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.613154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.614802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.639110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 908/1815] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:36.639248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.654767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c53e-aa11-4210-9d00-48431daf84c7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:36.668350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:36.672403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:36.673464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.673799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.673928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.674099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] PATH_INFO: `/v3/projects/f090a04c4c6b49198b2adc4d044897ef/users/8bdbfd3d90a4440c840e7f3cf2d00086/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.723351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f090a04c4c6b49198b2adc4d044897ef, user_id=8bdbfd3d90a4440c840e7f3cf2d00086, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:36.727801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52472db3-f4db-4042-b94d-87d0463d9318 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:36.770351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 908/1816] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:36 2022] PUT /identity/v3/projects/f090a04c4c6b49198b2adc4d044897ef/users/8bdbfd3d90a4440c840e7f3cf2d00086/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:36.783501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:36.784440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:36.784773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:36.824012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] MFA Rules not processed for user `8bdbfd3d90a4440c840e7f3cf2d00086`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:36.827719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:36.921378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef33ff2-eb87-4377-a45d-d54e60fdefec admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.049158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 909/1817] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:37.052703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.055378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:37.074448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.075204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.076283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.076600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.245693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.250602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.274234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 909/1818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:37.304672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669517b2-18c3-49f4-9e11-eaf774040ba3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.312834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.313818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.314053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.314332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.315070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.317691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.337843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:37.361869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 910/1819] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:37 2022] POST /identity/v3/projects => generated 407 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:37.365817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.377115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb873c-d88d-4ee2-a6f8-fac863d2cbf3 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.448596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.449387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.449766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.450118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.450964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.453054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.488381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 910/1820] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:37 2022] POST /identity/v3/users => generated 310 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:37.489951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.507130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772e32d-5990-4374-8ac0-42f5468599b1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.518671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.521367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:37.533076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.534361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.535499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.536520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.538852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.542909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.546951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7841b-ebea-4200-ad33-37a22dc331b8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.556767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.558397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.558898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.559403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] PATH_INFO: `/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.561724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80bb784fdf344c8bbc0cfb728e385fa)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.565936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.577672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 911/1821] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:37.583829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.607979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0714-f532-48c6-ba8e-ff8ca5894632 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.615439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.617012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.617778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.617996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] PATH_INFO: `/v3/projects/576c56896051401a912d718635c066a7/users/0f54210bec444806a4edc0370c771205/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.653143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576c56896051401a912d718635c066a7, user_id=0f54210bec444806a4edc0370c771205, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.656870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.693100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 912/1822] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:37 2022] PUT /identity/v3/projects/576c56896051401a912d718635c066a7/users/0f54210bec444806a4edc0370c771205/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:37.709162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.715908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80bb784fdf344c8bbc0cfb728e385fa', 'request_id': 'req-0e780764-8987-40f4-a9e2-d375098094dc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:37.742235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80bb784fdf344c8bbc0cfb728e385fa', 'request_id': 'req-0e780764-8987-40f4-a9e2-d375098094dc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:37.759491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80bb784fdf344c8bbc0cfb728e385fa', 'request_id': 'req-0e780764-8987-40f4-a9e2-d375098094dc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:37.779096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] The token cache is being invalidate because project b80bb784fdf344c8bbc0cfb728e385fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:37.779396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:37.780059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0e780764-8987-40f4-a9e2-d375098094dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:37.785851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 911/1823] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:37 2022] DELETE /identity/v3/projects/b80bb784fdf344c8bbc0cfb728e385fa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:37.789191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d51d5-8c90-4038-a2d2-4278fe9f4827 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.789491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d51d5-8c90-4038-a2d2-4278fe9f4827 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.789775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d51d5-8c90-4038-a2d2-4278fe9f4827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.813300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f2ce-736b-4717-8450-8f589def3154 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.835403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6c7d51d5-8c90-4038-a2d2-4278fe9f4827 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:37.836672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6c7d51d5-8c90-4038-a2d2-4278fe9f4827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:37.844122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:37.927803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.929704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.931155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.932964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.936794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:37.941734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:37.959695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 913/1824] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:37.963605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:37.968840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:37.981432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 912/1825] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:37.984141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:37.984620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:37.985063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:37.985520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa524-2beb-4116-ae77-ab56a29b11f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:37.992550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:37.993833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.007249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.008280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] PATH_INFO: `/v3/projects/576c56896051401a912d718635c066a7/users/0f54210bec444806a4edc0370c771205/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.011837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=576c56896051401a912d718635c066a7, user_id=0f54210bec444806a4edc0370c771205, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.015907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c18b0-e10b-4897-9d25-3ff73f5c0cdd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.018168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:38.025862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.033088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 914/1826] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:37 2022] PUT /identity/v3/projects/576c56896051401a912d718635c066a7/users/0f54210bec444806a4edc0370c771205/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:38.046504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.046963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.047355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.115504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] MFA Rules not processed for user `0f54210bec444806a4edc0370c771205`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:38.117043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.189282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 913/1827] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:38.193391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.195540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.211122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc6523-3138-49f9-b1e3-7ba12890035e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.222373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.223538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.223928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.224336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] PATH_INFO: `/v3/projects/c96c025efb5c489c886a742524efc48e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.226435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96c025efb5c489c886a742524efc48e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.228144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:38.232391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.273707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 915/1828] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:38.275653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.304861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab698-68e6-469d-bcd7-d8cb66791b15 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.332447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96c025efb5c489c886a742524efc48e', 'request_id': 'req-0c0a8787-b3b8-4b91-99a5-612522432008'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.350248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96c025efb5c489c886a742524efc48e', 'request_id': 'req-0c0a8787-b3b8-4b91-99a5-612522432008'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.371410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96c025efb5c489c886a742524efc48e', 'request_id': 'req-0c0a8787-b3b8-4b91-99a5-612522432008'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.385795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] The token cache is being invalidate because project c96c025efb5c489c886a742524efc48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:38.386083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.386931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.392294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 914/1829] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:38 2022] DELETE /identity/v3/projects/c96c025efb5c489c886a742524efc48e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:38.392294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.392294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.396525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.397739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.398035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.399107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.399244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:38.400117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.401891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c151973-14c5-4117-94fd-4aef9129dc72 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.421711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 916/1830] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:38.421711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.422750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.423040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.439285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:38.447857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:38.449204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.464236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 917/1831] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:38.464236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.469642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.475295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a8787-b3b8-4b91-99a5-612522432008 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.482783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd0237-b818-4102-bc5b-abf27d81922b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.484169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.485376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.485909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.486438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.487742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.488436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.488721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.489131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.489852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.491609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.491781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82792f-0e94-41aa-ad8b-9c0a52f222a2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.524660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 918/1832] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:38.524660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.524660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.524660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.541366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:38.542582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.572924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.574382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.585283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 915/1833] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:38.586081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.587447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.600604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e914d7e-d1e4-4305-a9cc-d3d63df35e55 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.613761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 919/1834] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:38.614622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.624686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106fec-f4f2-4928-a808-35a86a8272fb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.635174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.635174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.635174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.635174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.636044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.636044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.665146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 920/1835] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:38.666188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.666985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.668528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.669059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.669644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] PATH_INFO: `/v3/projects/5c04e72d367542c5b683d88d3f512552` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.671804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c04e72d367542c5b683d88d3f512552)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.675711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.679137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84365c05-23f8-488a-a8f7-6205a0f4e2ac admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.684729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.685632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.686047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.686407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.687215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:38.687593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.689341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.704835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 921/1836] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:38.709008 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.721096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e0348-0192-4a51-b120-d9e2e0873542 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.727011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.727913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.728417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.728609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.729351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.731203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.738235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:38.741553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c04e72d367542c5b683d88d3f512552', 'request_id': 'req-2226748e-665a-44e8-8698-b30d012b7c79'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.748952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c04e72d367542c5b683d88d3f512552', 'request_id': 'req-2226748e-665a-44e8-8698-b30d012b7c79'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.758318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 922/1837] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:38.759568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.773740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c04e72d367542c5b683d88d3f512552', 'request_id': 'req-2226748e-665a-44e8-8698-b30d012b7c79'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.774642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b70fa-f0f5-4134-8b19-486d7496602d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.793529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] The token cache is being invalidate because project 5c04e72d367542c5b683d88d3f512552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:38.793910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.795427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:38.797375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 916/1838] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:38 2022] DELETE /identity/v3/projects/5c04e72d367542c5b683d88d3f512552 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:38.798230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.801983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.824711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:38.853717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.854839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.855218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.855652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.857894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.860034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.886792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226748e-665a-44e8-8698-b30d012b7c79 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.893652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.894345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.894771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.894889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.895635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:38.897292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4830-cd71-4214-93e0-102775e5f3be admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:38.908144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 923/1839] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:38.909169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:38.915859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 917/1840] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:38.916999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.917966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.918553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.919609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.941640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:38.942871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:38.986529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c26e-1945-4a3e-9479-f89628a76d95 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:38.990150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:38.990831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:38.991123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:38.991493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:38.993316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.019968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 918/1841] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:39.019968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.019968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.030734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009c53b-2244-46f3-b4b4-1a87e7e27991 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.035424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.036099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.036425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.036709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.037410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.039466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.058227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.060280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376c10a-a566-4bbe-b4f0-20bfe80907d7 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.060530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 919/1842] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:39.061353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.070175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 924/1843] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:39.071353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.071646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.071932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.072537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa59d-2b0d-4585-b9a3-dfb8a1dbc57f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.078449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.079432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.079721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.079998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] PATH_INFO: `/v3/projects/68a4c6feb1344171a4e3b90f3fa1bb04/users/b3f5d64a2da7404caf01de004fa841a7/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.089947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:39.091245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.096342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a4c6feb1344171a4e3b90f3fa1bb04, user_id=b3f5d64a2da7404caf01de004fa841a7, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.099166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.099666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 925/1844] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:39.100277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.110140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345cd76-3944-443d-8249-36c0877dfa19 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.115027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.115695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.115981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.116294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.117021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.122843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 920/1845] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:39 2022] PUT /identity/v3/projects/68a4c6feb1344171a4e3b90f3fa1bb04/users/b3f5d64a2da7404caf01de004fa841a7/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:39.123021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd377a-2004-4611-8f44-ae50fbec396a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.123115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.132421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 926/1846] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:39.133573 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.134096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.134308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.152773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:39.154140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.173433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:39.205285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1b1-cc38-4e80-8e57-e1953e782b15 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.213028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.214115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.214419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.214729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.215740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:39.216560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.218408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.224570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 927/1847] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:39.225662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.240713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 921/1848] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:39.240920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557efa5-e13c-417e-8ad0-4d97b12dcf7f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.241036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.241036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.247713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.248477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.248826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.249135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.249881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.250352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:39.251602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.264438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 928/1849] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:39.268309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.278290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a7ed-582a-49a6-96b1-3cf85fdd38c7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.283608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.285013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.285833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.286206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.286907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.289348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.321715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390cc8-9da2-4fc8-a578-5b72f4fb9146 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.324143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 929/1850] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:39.328644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.385200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.385898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.386192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.386475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.430036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cfa51-4b01-481e-aa28-862744a7022e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.436742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.437650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.437937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.438217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] PATH_INFO: `/v3/projects/a5e8656645724cf594fb0de39462226a/users/17854f9f68634105be071c7691cfbb05/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.465010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e8656645724cf594fb0de39462226a, user_id=17854f9f68634105be071c7691cfbb05, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.465010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.489363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 930/1851] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:39 2022] PUT /identity/v3/projects/a5e8656645724cf594fb0de39462226a/users/17854f9f68634105be071c7691cfbb05/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:39.490338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.506012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.507886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd6a28-810f-42ca-b254-20a8a283043c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.535505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 922/1852] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:39.537353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.537657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.538313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.578809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] MFA Rules not processed for user `17854f9f68634105be071c7691cfbb05`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:39.580225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.594760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe689f-83ff-43bb-88fc-864bb837816d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.603003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.603960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.604663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.605115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.606687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.609223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.655441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 931/1853] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/users => generated 282 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:39.659301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.666275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:39.674962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d032-db53-4ab9-b6a5-0fb2f653f000 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.682341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.683483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.684139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.684523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.685965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.688067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.689424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:39.704802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 923/1854] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:39.705026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 932/1855] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:39.707783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.708438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.722432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4da22-42f1-4429-bb71-ccd620cd0b00 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.722662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4041-4faa-4d52-ad95-d6fc8a05af70 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.728634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.728994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.729310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.729599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.730036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.730166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.730246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.730609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.732011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.732715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.733463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.735129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.753362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 933/1856] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:39.757710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.772391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44b61-e11b-4c3a-8680-0a2914e6e491 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.780850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:39.781958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.782357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.782735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] PATH_INFO: `/v3/projects/f5711cfbd11e4323b952d7f79690af6f/users/28f6bb10dd5147daa843eb18929dd17e/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.799531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 924/1857] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:39.803625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:39.807155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5711cfbd11e4323b952d7f79690af6f, user_id=28f6bb10dd5147daa843eb18929dd17e, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:39.811198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b68c0-9f26-4326-b6e7-2368476728fe admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:39.831838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 934/1858] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:39 2022] PUT /identity/v3/projects/f5711cfbd11e4323b952d7f79690af6f/users/28f6bb10dd5147daa843eb18929dd17e/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:39.843089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:39.843588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:39.843985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:39.879100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] MFA Rules not processed for user `28f6bb10dd5147daa843eb18929dd17e`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:39.880479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:39.908963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082065-eaeb-49e4-a5e5-97b3b8f0c3a2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:39.969808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 935/1859] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:39.974517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.025354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.026302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.026774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.027117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.028982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.033300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.057160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecfde6-3024-46e9-bea9-d6ea49362564 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.067130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.067649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.067942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.068250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.068990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.069367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 925/1860] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/users => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:40.071072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.073259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.085655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9424-658b-4433-bdaa-2fef4472a9b5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.091479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.092633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.093083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.093558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.094643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.096563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.108246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 936/1861] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:39 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:40.110059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.112118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 926/1862] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:40.116154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.129908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbbd65-08bc-4cba-924b-41c9782c0ab1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.168249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:40.227493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84185a-9e08-484b-b045-80ccc36aa901 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.238259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.238955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.239234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.240884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.241590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.243556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.255943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.257721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.258080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.258506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] PATH_INFO: `/v3/projects/a45b99bde90f450db13cfd87f97421ba/users/137f8545fa6d46858d221ba29cd6fa2e/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.269755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 937/1863] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:40 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:40.270987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:40.274000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.280166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45b99bde90f450db13cfd87f97421ba, user_id=137f8545fa6d46858d221ba29cd6fa2e, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.283689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.286133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9501f3-40ee-4b4d-b0d2-b185bc1a9797 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.295466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.296441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.296740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.297029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.297931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.299668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.301444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 927/1864] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:40 2022] PUT /identity/v3/projects/a45b99bde90f450db13cfd87f97421ba/users/137f8545fa6d46858d221ba29cd6fa2e/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:40.305687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.316443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 938/1865] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:40.318518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.330880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f230-8cb1-4e64-ab54-90279d751894 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.375384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486565-cad3-470d-97bb-7be6121fcd29 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.380694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.381377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.381664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.381945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.382676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.384337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.396231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 928/1866] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:40.399738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.400769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.401925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.402297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.402671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] PATH_INFO: `/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75/users/9a66391ddc354148833318be128ef21f/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.416056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3edc7c-2228-40a8-8ddb-7e2bc34de0c5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.422429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.423435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.423795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c68aad82ac44cf9e0aaa5f99ad5e75, user_id=9a66391ddc354148833318be128ef21f, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.423935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.424213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] PATH_INFO: `/v3/projects/a45b99bde90f450db13cfd87f97421ba/users/137f8545fa6d46858d221ba29cd6fa2e/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.426802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.427084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45b99bde90f450db13cfd87f97421ba, user_id=137f8545fa6d46858d221ba29cd6fa2e, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.431079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5032e0-3035-4686-b010-64a36af63d2d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.443402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 939/1867] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:40 2022] PUT /identity/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75/users/9a66391ddc354148833318be128ef21f/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:40.444285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 929/1868] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:40 2022] PUT /identity/v3/projects/a45b99bde90f450db13cfd87f97421ba/users/137f8545fa6d46858d221ba29cd6fa2e/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:40.454415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.456222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.456889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.457229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.503723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] MFA Rules not processed for user `137f8545fa6d46858d221ba29cd6fa2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:40.507964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:40.550597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c287-9ba3-4290-b094-ff08889c3944 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.616588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:40.657039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 930/1869] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:40.671221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.680253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.680991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.682403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.682777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.689584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.691699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be26bd4-7504-4b87-a035-7cbf74eb25f7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.733386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 940/1870] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:40.735636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.736038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.736691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.788325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] MFA Rules not processed for user `b3f5d64a2da7404caf01de004fa841a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:40.789857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:40.837759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0b12-8f8e-4c9b-b7fa-54e80fd9b110 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.850549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.851283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.851666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.852526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.868860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.870904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.876255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:40.914250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 931/1871] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:40.915280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.929357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 941/1872] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:40.941634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:40.946472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f265-6cae-43ad-a53b-b8e863f2a361 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.953523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:40.954521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.954883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.955232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] PATH_INFO: `/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75/users/9a66391ddc354148833318be128ef21f/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:40.958449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c68aad82ac44cf9e0aaa5f99ad5e75, user_id=9a66391ddc354148833318be128ef21f, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:40.961991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851632-35db-48b2-b4e4-284fbbeb382e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:40.967594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb38ff2-53a4-4baa-a936-3c73b922120f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:40.981210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 932/1873] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:40 2022] PUT /identity/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75/users/9a66391ddc354148833318be128ef21f/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:40.996951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:40.997321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:40.997609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.035587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] MFA Rules not processed for user `9a66391ddc354148833318be128ef21f`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:41.037114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:41.048624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.049297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.049588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.049869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.050567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.052732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.081714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 942/1874] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:40 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:41.082557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.086047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:41.115002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 933/1875] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:41.115848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.128099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fea729-1bf7-432b-9505-d9d5eb130b04 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.156787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138207b8-5ac3-4cda-a206-28fc17c4db94 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.160661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.161438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.161736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.162021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.166441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:41.204046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.204839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.205152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.205463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.206201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.208259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.232296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 934/1876] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:41 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:41.232296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.234584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.236479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.242544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db8c14-007d-4b54-bf44-9cd9cea1cca0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.246624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.246881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 943/1877] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:41.248218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.253479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.254151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.255718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.260253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754213-7a3a-40a0-8a70-ce78deac19d4 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.267222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.268123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.268579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.268864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.269668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.271390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.286774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 944/1878] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:41.287799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.302342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6259-8f86-4de7-bf7f-3d575954e17b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.307990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.308940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.309227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.310133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] PATH_INFO: `/v3/projects/9e51190dfac84800a57697b393b909c5/users/c470843cdc3740eb81f3c7e5c53c77f2/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.331361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:41.336056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.339874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.351346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 935/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:41.375045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e51190dfac84800a57697b393b909c5, user_id=c470843cdc3740eb81f3c7e5c53c77f2, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.387305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.419413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 945/1880] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:41 2022] PUT /identity/v3/projects/9e51190dfac84800a57697b393b909c5/users/c470843cdc3740eb81f3c7e5c53c77f2/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:41.427092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.441724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e520ca-6408-4e7f-86ba-df33fe7952bb service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.527974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.558687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.559841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.560410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.560877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.562015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.564081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.577441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 936/1881] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:41.582498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:41.596610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1ded-1274-4818-aa01-28bfdf6206d5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.603320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.604656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.605185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.605599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] PATH_INFO: `/v3/projects/9e51190dfac84800a57697b393b909c5/users/c470843cdc3740eb81f3c7e5c53c77f2/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.606814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12361e-64a1-4f25-979d-cc0651abda1e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:41.608042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e51190dfac84800a57697b393b909c5, user_id=c470843cdc3740eb81f3c7e5c53c77f2, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.610895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055be91-1059-4c91-8e0e-3e4301a53f9f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.625348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 937/1882] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:41 2022] PUT /identity/v3/projects/9e51190dfac84800a57697b393b909c5/users/c470843cdc3740eb81f3c7e5c53c77f2/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:41.696691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:41.697358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:41.697648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:41.697929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:41.745710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:41.766517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:41.768072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:41.777818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 946/1883] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:42.399570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:42.400533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:42.400817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:42.434021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] MFA Rules not processed for user `c470843cdc3740eb81f3c7e5c53c77f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:42.435841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:42.516296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 938/1884] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:42.531238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:42.540130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbad6a-0f7d-4e42-b7ac-2e4c68194acd service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:42.545654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:42.546292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:42.546580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:42.546863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:42.622960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:42.624584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:42.636535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 947/1885] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:45.177180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:45.189692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ae4ec-8f03-44fc-a279-9ee9f3231b72 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:45.194136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:45.194801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:45.195091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:45.195387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:45.207178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:45.208537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b854d59-9a5f-4ffa-af58-c69a95f96447 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:45.228667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 939/1886] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:46.067494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:46.133875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325de84-719f-4baa-ab22-a6369d09f507 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:46.139968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:46.140992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:46.141436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:46.141756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] PATH_INFO: `/v3/users/28f6bb10dd5147daa843eb18929dd17e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:46.142977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f6bb10dd5147daa843eb18929dd17e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:46.145028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:46.230261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f6bb10dd5147daa843eb18929dd17e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:46.232751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f6bb10dd5147daa843eb18929dd17e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:46.246900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f6bb10dd5147daa843eb18929dd17e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:46.269239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f6bb10dd5147daa843eb18929dd17e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:46.283115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f6bb10dd5147daa843eb18929dd17e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:46.285352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:46.302789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 948/1887] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:46 2022] DELETE /identity/v3/users/28f6bb10dd5147daa843eb18929dd17e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:46.307515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:46.308008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:46.308121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:46.332160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:46.334184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:46.394725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:46.416421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 940/1888] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:46.426932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:46.428748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:46.501280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20853-190a-4470-9947-c55a8edc8551 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:46.506127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:46.507906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:46.508422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:46.509088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:46.520252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:46.522000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:46.544892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 949/1889] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:46.917704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:46.919811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:46.944625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5094b8-f43f-49e0-90fb-2a395aef7775 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:46.959470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:46.961550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:46.961827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:46.962459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] PATH_INFO: `/v3/projects/f5711cfbd11e4323b952d7f79690af6f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:46.967639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5711cfbd11e4323b952d7f79690af6f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:46.970859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:47.040051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5711cfbd11e4323b952d7f79690af6f', 'request_id': 'req-bcb25b4a-c746-4f61-9afd-b079452c1d8c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.049485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5711cfbd11e4323b952d7f79690af6f', 'request_id': 'req-bcb25b4a-c746-4f61-9afd-b079452c1d8c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.060095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5711cfbd11e4323b952d7f79690af6f', 'request_id': 'req-bcb25b4a-c746-4f61-9afd-b079452c1d8c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.079112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] The token cache is being invalidate because project f5711cfbd11e4323b952d7f79690af6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:47.079668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.080633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bcb25b4a-c746-4f61-9afd-b079452c1d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.084435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 941/1890] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:46 2022] DELETE /identity/v3/projects/f5711cfbd11e4323b952d7f79690af6f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:47.088627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.101566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e6c71-3e2a-4889-a243-d25eb127bc91 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:47.123100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.123430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.123676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.128908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 942/1891] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:47:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:47:47.157270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.159959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.249113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:47.250515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.251070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.251945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] PATH_INFO: `/v3/users/9a66391ddc354148833318be128ef21f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.254131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a66391ddc354148833318be128ef21f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:47.256923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:47.265428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa77e9-2db8-4705-a2e6-4432cd3d1d9e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:47.270992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:47.272820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.273134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.273458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] PATH_INFO: `/v3/users/17854f9f68634105be071c7691cfbb05` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.274877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17854f9f68634105be071c7691cfbb05)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:47.277503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:47.339123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a66391ddc354148833318be128ef21f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.340168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a66391ddc354148833318be128ef21f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.354039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a66391ddc354148833318be128ef21f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.374815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17854f9f68634105be071c7691cfbb05'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.400958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a66391ddc354148833318be128ef21f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.429541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2109ff5a-9917-4c36-ae73-82319266067f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a66391ddc354148833318be128ef21f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.431955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17854f9f68634105be071c7691cfbb05'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.442487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17854f9f68634105be071c7691cfbb05'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.443628 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 950/1892] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:47 2022] DELETE /identity/v3/users/9a66391ddc354148833318be128ef21f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:47.445290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471ba8-909c-4a2b-b568-f392cb09f06c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.445934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471ba8-909c-4a2b-b568-f392cb09f06c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.446574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471ba8-909c-4a2b-b568-f392cb09f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.460676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:47.471820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17854f9f68634105be071c7691cfbb05'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.473179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17854f9f68634105be071c7691cfbb05'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.474834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ef471ba8-909c-4a2b-b568-f392cb09f06c None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:47.477072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef471ba8-909c-4a2b-b568-f392cb09f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.485802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 943/1893] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:47 2022] DELETE /identity/v3/users/17854f9f68634105be071c7691cfbb05 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:47.489281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.490809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.496286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:47.587318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 951/1894] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:47.588828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.589289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.589644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.617855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:47.619373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.620929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7945-c4d4-4f80-bfbc-7f8272a25f59 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:47.626319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:47.627370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.627483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.627761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] PATH_INFO: `/v3/users/8bdbfd3d90a4440c840e7f3cf2d00086` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.631310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 952/1895] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:47.631310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.632645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.639643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdbfd3d90a4440c840e7f3cf2d00086)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:47.642645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:47.734947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdbfd3d90a4440c840e7f3cf2d00086'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.735539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7414-70a6-4b76-a78e-f7d161c815ad None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:47.741689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:47.742434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.742795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.743150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.749796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdbfd3d90a4440c840e7f3cf2d00086'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.752574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:47.754184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:47.759428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdbfd3d90a4440c840e7f3cf2d00086'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.766719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 953/1896] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:47.767940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.769515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.771537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdbfd3d90a4440c840e7f3cf2d00086'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.772237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-00182e73-81bc-42f1-bada-9d61e8e8dbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdbfd3d90a4440c840e7f3cf2d00086'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:47.780574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 944/1897] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:47 2022] DELETE /identity/v3/users/8bdbfd3d90a4440c840e7f3cf2d00086 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:47.785025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.785375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.785885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.808506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:47.810349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.851390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b430b0-d1b0-49c7-b130-b2342294d2fe service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:47.888622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 945/1898] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:47.897112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:47.899789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:47.934549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:47.938716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:47.966643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:47.990295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:47.990295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:47.990295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:47.990295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.003576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6247b4-8648-43c0-94fd-4d1e87c5bd52 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.005886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.006971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.009673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.010636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.011980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.012474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.019480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 954/1899] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:48.020500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.021987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.025627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.027459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58414d0-721f-4ddb-9e54-6fab5b5d8b34 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.045464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 946/1900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:48.047254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e3e8-14ed-4a36-9147-eccecfbe31a5 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.052837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.053788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.054147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.054519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] PATH_INFO: `/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.055775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c68aad82ac44cf9e0aaa5f99ad5e75)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.058272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.119827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c68aad82ac44cf9e0aaa5f99ad5e75', 'request_id': 'req-3ec8b8d3-69fe-4286-8d34-514bad8ef245'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.131313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c68aad82ac44cf9e0aaa5f99ad5e75', 'request_id': 'req-3ec8b8d3-69fe-4286-8d34-514bad8ef245'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.141622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c68aad82ac44cf9e0aaa5f99ad5e75', 'request_id': 'req-3ec8b8d3-69fe-4286-8d34-514bad8ef245'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.205824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] The token cache is being invalidate because project a6c68aad82ac44cf9e0aaa5f99ad5e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:48.206023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.206917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec8b8d3-69fe-4286-8d34-514bad8ef245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.214067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 955/1901] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:48 2022] DELETE /identity/v3/projects/a6c68aad82ac44cf9e0aaa5f99ad5e75 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:48.215848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.216152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.216663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.274310 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:48.293646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.391296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 947/1902] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:48.398945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.399279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.399547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.456379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.457929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.468163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:48.470807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.489459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083a4d8-52c6-4dab-a6b3-f25764569723 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.492846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 956/1903] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:48.497091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.505470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.506888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.506888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.506888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] PATH_INFO: `/v3/projects/a5e8656645724cf594fb0de39462226a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.508930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e8656645724cf594fb0de39462226a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.511527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1c7b-619a-463d-9094-81253c8d94b1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.514511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.518800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.519945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.520493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.521060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.522241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:48.523139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.525545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.541856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 957/1904] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:48.547396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.560375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8b0e-6391-46cf-a4a2-fae3faa3004b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.566952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.568612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.569178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.569660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.571099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.573803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.628287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 958/1905] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:48 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:48.631195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e8656645724cf594fb0de39462226a', 'request_id': 'req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.633509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.647193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e8656645724cf594fb0de39462226a', 'request_id': 'req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.664355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e8656645724cf594fb0de39462226a', 'request_id': 'req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.686639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] The token cache is being invalidate because project a5e8656645724cf594fb0de39462226a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:48.687318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.689037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.695216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 948/1906] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:48 2022] DELETE /identity/v3/projects/a5e8656645724cf594fb0de39462226a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:48.696470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.697896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.736609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c260f-0b04-4194-8f36-782bdb75a10d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.743183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.743969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.744361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.744843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.745565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.749009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.761232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:48.788071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 959/1907] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:48 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:48.799216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.802021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdc6bf-2d8d-4390-ac0d-c9d1661d6196 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.805326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:48.807798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.809030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.810159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.810758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] PATH_INFO: `/v3/users/137f8545fa6d46858d221ba29cd6fa2e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.812626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137f8545fa6d46858d221ba29cd6fa2e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.815166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.831312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5c8fb-d8de-4218-88f2-8bc5fbf44926 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.843170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.843853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.844135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.844567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.845311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.848170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.876702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 960/1908] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:48.880676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.896401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9c5e-b129-492d-81d1-6a76904cd2a1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:48.904251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:48.906193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:48.906704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:48.907243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:48.908016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:48.911412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:48.914931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:48.930976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137f8545fa6d46858d221ba29cd6fa2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.968401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 961/1909] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:48.972439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:48.972801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137f8545fa6d46858d221ba29cd6fa2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:48.987878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137f8545fa6d46858d221ba29cd6fa2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.000413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49602-6c7c-4a43-a66a-2f6642050291 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.005825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137f8545fa6d46858d221ba29cd6fa2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.007677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137f8545fa6d46858d221ba29cd6fa2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.017819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.020179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.020731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.021196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] PATH_INFO: `/v3/projects/a1630b4f36b34a47b9ceb3c5dcfa291f/users/7883c96d7a8a4017b6c5902d4eb0e87f/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.029408 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 949/1910] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:48 2022] DELETE /identity/v3/users/137f8545fa6d46858d221ba29cd6fa2e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:49.031137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.032612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.064983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1630b4f36b34a47b9ceb3c5dcfa291f, user_id=7883c96d7a8a4017b6c5902d4eb0e87f, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.074635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02260fc-07bd-4bc6-8e39-c7a591cc32a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.108827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 962/1911] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:48 2022] PUT /identity/v3/projects/a1630b4f36b34a47b9ceb3c5dcfa291f/users/7883c96d7a8a4017b6c5902d4eb0e87f/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:49.119221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.119600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.119903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.134234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe50c3e-d8dc-4404-b91a-3b3402bdf614 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.171991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] MFA Rules not processed for user `7883c96d7a8a4017b6c5902d4eb0e87f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:49.173318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.217403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.218993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.219438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.219824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] PATH_INFO: `/v3/projects/f090a04c4c6b49198b2adc4d044897ef` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.221766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f090a04c4c6b49198b2adc4d044897ef)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.225243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.245177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:49.297829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 963/1912] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:49.302201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.304257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.320129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ca7d-08fb-4615-9e34-b35f302fa5bd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.328685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f090a04c4c6b49198b2adc4d044897ef', 'request_id': 'req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.335417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f090a04c4c6b49198b2adc4d044897ef', 'request_id': 'req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.345294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f090a04c4c6b49198b2adc4d044897ef', 'request_id': 'req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.360672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] The token cache is being invalidate because project f090a04c4c6b49198b2adc4d044897ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:49.361099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.361828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.366193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 950/1913] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:49 2022] DELETE /identity/v3/projects/f090a04c4c6b49198b2adc4d044897ef => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:49.367971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.370157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.401621 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.403661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.404279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.404917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.406350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.409702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.454159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 964/1914] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:49.454159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.454838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.468419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd55a6-b2a6-4e12-b9eb-2dcb4470ea2e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.509410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:49.527546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e678b3-f71e-41aa-83fd-d2203cfc34da admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.533554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.534355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.534649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.534924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] PATH_INFO: `/v3/projects/a45b99bde90f450db13cfd87f97421ba` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.536284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45b99bde90f450db13cfd87f97421ba)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.538414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.547906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.548929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.549223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.549541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] PATH_INFO: `/v3/users/0f54210bec444806a4edc0370c771205` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.551539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f54210bec444806a4edc0370c771205)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.553704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.598541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45b99bde90f450db13cfd87f97421ba', 'request_id': 'req-5adea19b-db32-412d-9ec7-aebb7416782b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.605900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:49.609396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45b99bde90f450db13cfd87f97421ba', 'request_id': 'req-5adea19b-db32-412d-9ec7-aebb7416782b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.609721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f54210bec444806a4edc0370c771205'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.618007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45b99bde90f450db13cfd87f97421ba', 'request_id': 'req-5adea19b-db32-412d-9ec7-aebb7416782b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.625870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f54210bec444806a4edc0370c771205'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.630830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] The token cache is being invalidate because project a45b99bde90f450db13cfd87f97421ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:49.631181 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.634607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f54210bec444806a4edc0370c771205'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.637681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.639324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 965/1915] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:49 2022] DELETE /identity/v3/projects/a45b99bde90f450db13cfd87f97421ba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:49.640279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.641725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.648334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f54210bec444806a4edc0370c771205'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.648770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b778dd8c-0b6d-49f7-b378-2bc5fa1b7d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f54210bec444806a4edc0370c771205'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:49.663915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 951/1916] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:49 2022] DELETE /identity/v3/users/0f54210bec444806a4edc0370c771205 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:49.666261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f340-693f-428b-8e11-fc872f47d902 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.666545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f340-693f-428b-8e11-fc872f47d902 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.666839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f340-693f-428b-8e11-fc872f47d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.690645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e981f340-693f-428b-8e11-fc872f47d902 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:49.691885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e981f340-693f-428b-8e11-fc872f47d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.788818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 952/1917] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:49.795436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.795725 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.796265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.821210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea19b-db32-412d-9ec7-aebb7416782b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.834294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.834990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.835279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.835594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.837026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:49.838280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.839615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.841921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.852370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 953/1918] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:49.854303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.866422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbb7ce-d807-4a5f-b3f5-5673c87367c3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.875591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.879027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 966/1919] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:49.880659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.880788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.881210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.881653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.882602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:49.883259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.883501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:49.885773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.900505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc71f3-f34b-47c0-a50a-84666838c93e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.905932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 954/1920] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:47:49.907090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.908692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.909488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.909880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.910331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.911339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.913647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.923269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73cf63-be46-485f-9918-cfa6b074ae0c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.930363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.930960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 967/1921] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:49.932853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.933375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.934068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.934952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:49.935658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:49.937359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:49.946539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b02a-8e66-40ae-bad4-2ea586d647cb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:49.955680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:49.957378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:49.957706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:49.957993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] PATH_INFO: `/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3/users/0dac44944d314ecbbd97415aa4557216/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:49.976558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 955/1922] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:49.980539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.000681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dda76b8a1d4cc3a7f1739dcb9ccee3, user_id=0dac44944d314ecbbd97415aa4557216, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.009234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.041443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 968/1923] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:49 2022] PUT /identity/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3/users/0dac44944d314ecbbd97415aa4557216/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:50.042713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.086663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453985-e243-4d62-a7eb-82959d9242fc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.102277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:50.131909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:50.193499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.194333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.194873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.195420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.196118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.198401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.205408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24d3f5-e123-4a2f-b3b7-41a1f3627403 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.215746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.223321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.223664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.226675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.228995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.231048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.238560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 956/1924] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:49 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:50.250113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.257047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.275168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 969/1925] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:50.280590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.294705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face8bf-d572-45de-85a4-6b568e1508f1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.308624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a415c-b015-4180-96c7-dc46b5270d64 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.315342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.316249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.316537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.318236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] PATH_INFO: `/v3/projects/576c56896051401a912d718635c066a7` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.321065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=576c56896051401a912d718635c066a7)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.324643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.329586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.332523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.333676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.334497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.337130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.341059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.368385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 970/1926] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:50.373239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.395511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649c31-b4a7-41cf-b397-dc8c9824e424 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.409062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.410017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.410264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.410543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] PATH_INFO: `/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3/users/0dac44944d314ecbbd97415aa4557216/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.414817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dda76b8a1d4cc3a7f1739dcb9ccee3, user_id=0dac44944d314ecbbd97415aa4557216, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.419786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.424815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576c56896051401a912d718635c066a7', 'request_id': 'req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:50.432171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576c56896051401a912d718635c066a7', 'request_id': 'req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:50.442848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576c56896051401a912d718635c066a7', 'request_id': 'req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:50.448038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 971/1927] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:50 2022] PUT /identity/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3/users/0dac44944d314ecbbd97415aa4557216/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:50.460708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.460931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] The token cache is being invalidate because project 576c56896051401a912d718635c066a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:50.460931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:50.464648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4bdc4d64-ab2e-48bc-b722-ca50173bc8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:50.468549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 957/1928] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:50 2022] DELETE /identity/v3/projects/576c56896051401a912d718635c066a7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:50.470833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.471411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.471921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.522203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] MFA Rules not processed for user `0dac44944d314ecbbd97415aa4557216`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:50.523890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.601372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e62-80f9-4ae1-8435-44dbce7a64da admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.607691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.608186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.608323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.608603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.609703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.611332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c782-6402-4d79-91bc-4d166488b27f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.634064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 972/1929] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:50.639384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.639841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.640134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.642491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 958/1930] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:50.646764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.653376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.673107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d2d8-b4a2-4f08-95e6-1f7e5cefcb29 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.677998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.678335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:50.678977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.679404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.679604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.679702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] PATH_INFO: `/v3/projects/38337c1ecbcb448b91fa3ed07198b903/users/8048131f350949d59062e92b0386e4c4/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.693043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 973/1931] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:50.693043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.693043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.703853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38337c1ecbcb448b91fa3ed07198b903, user_id=8048131f350949d59062e92b0386e4c4, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.706815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46b47f-f696-4047-8fb7-47339102e217 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.719695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:50.727985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 959/1932] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:50 2022] PUT /identity/v3/projects/38337c1ecbcb448b91fa3ed07198b903/users/8048131f350949d59062e92b0386e4c4/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:50.729831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff12b-8650-4eb3-a106-f6658bbf6889 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.730406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff12b-8650-4eb3-a106-f6658bbf6889 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.730945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff12b-8650-4eb3-a106-f6658bbf6889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.757394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-897ff12b-8650-4eb3-a106-f6658bbf6889 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:50.758556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-897ff12b-8650-4eb3-a106-f6658bbf6889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.769922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b89d1-0d0c-4c23-92b1-3419e9dcf1b2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.834217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.834877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.835324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.835532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.839931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:50.841720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 960/1933] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:50.843265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.843562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.843847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.874512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] MFA Rules not processed for user `8048131f350949d59062e92b0386e4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:50.875785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:50.909580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.911073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.923652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 974/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:50.925012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.938052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c3cd-82c5-4401-8119-96ec21069dea service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.944746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.945525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.946000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.946350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.947259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:50.947641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:50.949614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:50.974516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 975/1935] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:50.975852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:50.981839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 961/1936] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:50.989815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e68b1-5f7c-487f-97f4-cff4f5dd0771 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:50.995743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:50.996548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:50.997406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:50.997760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:50.998521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.000717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.017049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.031042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d268b9-3871-4834-bf1f-45ba5b7b8f75 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.037594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.038318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.038602 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.038877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.047417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 976/1937] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:50 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:51.048727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.057370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.060003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.107836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 962/1938] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:51.121754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.142859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fdc98-8836-41da-952d-554a16e0a3d6 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.152833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.154454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dddbe3-6df9-4018-86c3-83d52788c9c9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.154744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.155436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.156006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] PATH_INFO: `/v3/users/8048131f350949d59062e92b0386e4c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.157757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8048131f350949d59062e92b0386e4c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.160246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.160368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.161903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.162494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.162753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.163721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.167023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.216063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 977/1939] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:51 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:51.223066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.238588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64068b67-d833-4822-9e34-c2165151c5c2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.253267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8048131f350949d59062e92b0386e4c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:51.256147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.257255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.258003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.258638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.259604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.263737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.273608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8048131f350949d59062e92b0386e4c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:51.278952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 978/1940] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:51.286730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:51.292984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8048131f350949d59062e92b0386e4c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:51.296864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.303013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8048131f350949d59062e92b0386e4c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:51.303834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-48e04966-5e0e-4c96-8f82-918491810efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8048131f350949d59062e92b0386e4c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:51.308910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1acaa8-1e68-4e04-84d8-b7e38060fda8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.319836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 963/1941] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:51 2022] DELETE /identity/v3/users/8048131f350949d59062e92b0386e4c4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:51.323527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.324420 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.324790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.325741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.325960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.326446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.326863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.328475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.330792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.345144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:51.346487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:51.348633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 979/1942] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:51.352760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.354538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:51.394817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3fae-9f88-46bc-a763-e67d0ef6194a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.424934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 964/1943] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:51.449885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.451684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:51.468512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:51.514394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.515485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.515766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.516082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] PATH_INFO: `/v3/projects/ab1242fb43cd4a558d00b1750834a113/users/0902f04a7c8440c889d7651d46d48e2f/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.538248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1242fb43cd4a558d00b1750834a113, user_id=0902f04a7c8440c889d7651d46d48e2f, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.541465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ce0c-4e0b-4084-9e2e-d8cb39ed8f22 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.556913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 980/1944] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:51 2022] PUT /identity/v3/projects/ab1242fb43cd4a558d00b1750834a113/users/0902f04a7c8440c889d7651d46d48e2f/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:51.567604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903b75-6c61-47b7-a9a7-a089bc014046 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.570880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.571173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.571460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.618342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] MFA Rules not processed for user `0902f04a7c8440c889d7651d46d48e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:51.619617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:51.640082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.640911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.641287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.641644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.711085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 981/1945] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:51.721583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:51.721747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:51.723606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:51.725038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.726903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.741666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 965/1946] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:51.801900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed598f-2472-4dc4-988f-8cb76ea43e15 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:51.807426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:51.808132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:51.808441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:51.808714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:51.825003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:51.826822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4beee70-0d83-43ba-92e6-770ffbdf65e8 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:51.840886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 982/1947] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:52.164320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.164320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:52.184830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080632-4066-48c5-8abe-670e548a6b1f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.225848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.227070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.227436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.227724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] PATH_INFO: `/v3/projects/38337c1ecbcb448b91fa3ed07198b903` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.229281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38337c1ecbcb448b91fa3ed07198b903)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.232247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:52.353915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38337c1ecbcb448b91fa3ed07198b903', 'request_id': 'req-e8a50965-7310-4d58-9019-ae28cc204994'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:52.368078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38337c1ecbcb448b91fa3ed07198b903', 'request_id': 'req-e8a50965-7310-4d58-9019-ae28cc204994'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:52.385802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38337c1ecbcb448b91fa3ed07198b903', 'request_id': 'req-e8a50965-7310-4d58-9019-ae28cc204994'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:52.408350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] The token cache is being invalidate because project 38337c1ecbcb448b91fa3ed07198b903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:52.408653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:52.410869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e8a50965-7310-4d58-9019-ae28cc204994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:52.414194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 966/1948] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:52 2022] DELETE /identity/v3/projects/38337c1ecbcb448b91fa3ed07198b903 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:52.420478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.421127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.421127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.453798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:52.456598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:52.545129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:52.589999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 983/1949] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:52.598446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.598941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.599119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.620412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:52.622165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:52.649733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 967/1950] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:52.654161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.669155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdaab9-634d-40da-a4e0-fc60eadef311 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.681413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.682092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.682389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.682665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.683429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:52.683771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.685964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:52.716333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 984/1951] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:52.722832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.737089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9855f6c-77e3-46f7-b307-ab458a965a89 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.753063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.753682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.754111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.754429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.755102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.757758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:52.813564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 968/1952] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:52 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:52.821099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.832998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56de3f-c9be-4d8f-b7fc-cb5283d3eca1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.905088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.905769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.906061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.906343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.907039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.909035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:52.930140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 985/1953] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:52 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:52.934309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.946049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6c4ba-ed81-461f-b733-26d70ee7c39c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.951238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.951906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.952244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.952506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.953507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.955110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:52.965729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 969/1954] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:52.969759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:52.981732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24096ec-750f-49e6-9785-cec3986be766 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:52.986739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:52.987411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:52.987700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:52.987981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:52.988749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:52.990350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:53.004473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 986/1955] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:53.005924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:53.006059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:53.007613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.018362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e76e5-980a-488a-afde-1fb9a1c083ab admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:53.021463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc44e-d53a-40b9-bff1-e9096ac82be4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:53.023082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:53.023968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.024287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.024571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] PATH_INFO: `/v3/projects/184fd1677ed4470898f71d3c7edd7a95/users/f399813ae860481d932f03c109e037f9/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.026225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:53.027094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.027387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.027667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] PATH_INFO: `/v3/users/7883c96d7a8a4017b6c5902d4eb0e87f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.029011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7883c96d7a8a4017b6c5902d4eb0e87f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:53.030965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:53.039994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184fd1677ed4470898f71d3c7edd7a95, user_id=f399813ae860481d932f03c109e037f9, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:53.042719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d966503-ae6f-4ae0-ace3-49573d429614 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:53.060133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 970/1956] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:53 2022] PUT /identity/v3/projects/184fd1677ed4470898f71d3c7edd7a95/users/f399813ae860481d932f03c109e037f9/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:53.075201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.075481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.075766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.091611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7883c96d7a8a4017b6c5902d4eb0e87f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:53.092348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7883c96d7a8a4017b6c5902d4eb0e87f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:53.099943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7883c96d7a8a4017b6c5902d4eb0e87f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:53.104410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] MFA Rules not processed for user `f399813ae860481d932f03c109e037f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:53.105636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.118414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7883c96d7a8a4017b6c5902d4eb0e87f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:53.132462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8b3d7801-9d0b-4f33-a488-728cd99ff72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7883c96d7a8a4017b6c5902d4eb0e87f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:53.140707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 987/1957] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:53 2022] DELETE /identity/v3/users/7883c96d7a8a4017b6c5902d4eb0e87f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:53.146818 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.147118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.147403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.169467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:53.170707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.192341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 971/1958] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:53.195550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:53.202722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:53.204673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.211492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:53.253846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 988/1959] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:53.263954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:53.265859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.275013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937970c1-a618-4800-9783-1a8ce723ba7e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:53.341901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eefd5-d2bd-4b7d-a0a4-fbdc3b6abdd5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:53.345736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:53.346414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.346707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.346989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.348903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:53.349578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.349872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.350167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.358852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:53.360436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:53.374079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 989/1960] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:53.417667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:53.420231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:53.430442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 972/1961] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:47:53.779351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:53.781718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:53.817682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f120-211e-4001-809d-554a29665f68 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:53.830044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:53.831142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:53.831512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:53.831748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] PATH_INFO: `/v3/projects/a1630b4f36b34a47b9ceb3c5dcfa291f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:53.836949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1630b4f36b34a47b9ceb3c5dcfa291f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:53.841971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:54.007256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1630b4f36b34a47b9ceb3c5dcfa291f', 'request_id': 'req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.025817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1630b4f36b34a47b9ceb3c5dcfa291f', 'request_id': 'req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.037183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1630b4f36b34a47b9ceb3c5dcfa291f', 'request_id': 'req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.054590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] The token cache is being invalidate because project a1630b4f36b34a47b9ceb3c5dcfa291f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:54.054590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.056088 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.058283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 990/1962] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:53 2022] DELETE /identity/v3/projects/a1630b4f36b34a47b9ceb3c5dcfa291f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:54.071393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:54.100511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1b89-bc0e-4660-8c18-84344ca1ddf2 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:54.201756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:54.201756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:54.201756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:54.201756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] PATH_INFO: `/v3/users/0dac44944d314ecbbd97415aa4557216` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:54.202065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dac44944d314ecbbd97415aa4557216)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:54.202065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:54.222280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:54.257306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dac44944d314ecbbd97415aa4557216'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.270793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dac44944d314ecbbd97415aa4557216'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.279117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dac44944d314ecbbd97415aa4557216'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.286261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dac44944d314ecbbd97415aa4557216'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.286876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a11399b7-c86a-46d3-a71c-c7a0e5db8cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dac44944d314ecbbd97415aa4557216'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.293273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 973/1963] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:54 2022] DELETE /identity/v3/users/0dac44944d314ecbbd97415aa4557216 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:54.685855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:54.688049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:54.707196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ff6f-f384-4e36-9ca1-df243a8c49f6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:54.764065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:54.778605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:54.779043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:54.780101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:54.780753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] PATH_INFO: `/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:54.781951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dda76b8a1d4cc3a7f1739dcb9ccee3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:54.784590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:54.836093 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dda76b8a1d4cc3a7f1739dcb9ccee3', 'request_id': 'req-171f1da1-07b4-48aa-9fee-04ba17078193'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.843715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dda76b8a1d4cc3a7f1739dcb9ccee3', 'request_id': 'req-171f1da1-07b4-48aa-9fee-04ba17078193'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.849610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dda76b8a1d4cc3a7f1739dcb9ccee3', 'request_id': 'req-171f1da1-07b4-48aa-9fee-04ba17078193'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.860728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] The token cache is being invalidate because project f6dda76b8a1d4cc3a7f1739dcb9ccee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:54.861016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.861654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-171f1da1-07b4-48aa-9fee-04ba17078193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:54.863204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 991/1964] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:54 2022] DELETE /identity/v3/projects/f6dda76b8a1d4cc3a7f1739dcb9ccee3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:54.868140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:54.868550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:54.868918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:54.889044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:54.890307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:54.960461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 974/1965] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:54.966673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:54.967164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:54.967478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:54.989472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:54.990710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:55.000109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 992/1966] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:55.005037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.016733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00851-2877-40ca-b600-eccf9eeb8cf9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.021351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.022011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.022294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.022615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.023345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:55.023653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.025306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.037672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 975/1967] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:55.042111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.052319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bfab0-91f1-4f3f-a67e-b3e90733b630 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.057258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.057917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.058204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.058479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.059221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.061198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.090639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 993/1968] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:55 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:55.091822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.102041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d24f-0dd0-4263-bb96-df76f87b7fbe admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.162893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.163568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.163854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.164131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.164863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.166786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.190246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 976/1969] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:55 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:55.191395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.202280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3970d67-4f2a-4b91-8f8a-79c4c613f6a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.208831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.210029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.210029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.210029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.210766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.212396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.223382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 994/1970] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:55.227206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.249107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3fbd-ea1c-4b02-9b8f-2d640d610a55 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.255852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.256651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.256938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.257217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.258181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.260058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1bf56-1e09-43a3-8706-2466a3081803 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.267123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:55.278294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.284402 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 977/1971] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:55.290457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6f47-d255-4078-b734-237b01509207 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.296475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.297373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.297661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.304329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] PATH_INFO: `/v3/projects/952141993af04b9a86c42865f711df91/users/7ea0fb760f1a4c09a60fbbe7242191fa/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.327136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] RBAC: Authorizing `identity:create_grant(project_id=952141993af04b9a86c42865f711df91, user_id=7ea0fb760f1a4c09a60fbbe7242191fa, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.330189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.345599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 995/1972] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:55 2022] PUT /identity/v3/projects/952141993af04b9a86c42865f711df91/users/7ea0fb760f1a4c09a60fbbe7242191fa/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:47:55.357298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.357595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.357882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.388380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] MFA Rules not processed for user `7ea0fb760f1a4c09a60fbbe7242191fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:55.389710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:55.489304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 978/1973] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:55.502295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.504068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:55.567385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efdf63-07be-42bb-831e-58682bdf386a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.571246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.571910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.572218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.572521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.582244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.583718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79e904-4f26-43fb-b4c2-9cf94ecc4feb service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.594332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 996/1974] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:55.614302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.686544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6550fe-bf3c-481a-b881-4952b5735ea6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:55.691227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:55.692404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.692404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.692655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] PATH_INFO: `/v3/users/7ea0fb760f1a4c09a60fbbe7242191fa` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.693884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea0fb760f1a4c09a60fbbe7242191fa)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:55.695851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:55.746444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea0fb760f1a4c09a60fbbe7242191fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:55.760462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea0fb760f1a4c09a60fbbe7242191fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:55.768846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea0fb760f1a4c09a60fbbe7242191fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:55.778949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea0fb760f1a4c09a60fbbe7242191fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:55.784694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea0fb760f1a4c09a60fbbe7242191fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:55.796405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 979/1975] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:47:55 2022] DELETE /identity/v3/users/7ea0fb760f1a4c09a60fbbe7242191fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:55.800883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:55.801396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:55.801477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:55.826648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:55.827890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:55.849427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:55.908448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 997/1976] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:55.933284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:55.934981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:55.955032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:56.017240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5204-de72-44dc-b809-924387b2ae8a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:56.021428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:56.022084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.022368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.023985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.042591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:56.045010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b086-0d7a-4079-9a30-4044d95b82fe service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:56.057726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 980/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:47:56.516219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:56.518070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:56.561410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0687e-ac24-470b-b2da-89ffb3dec1ca None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:56.566154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:56.567466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.567466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.567702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] PATH_INFO: `/v3/projects/952141993af04b9a86c42865f711df91` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.568894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] RBAC: Authorizing `identity:delete_project(project_id=952141993af04b9a86c42865f711df91)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:56.571050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:56.642163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952141993af04b9a86c42865f711df91', 'request_id': 'req-cad46c42-aab9-4a95-aaa9-b797763b717b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:56.657986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952141993af04b9a86c42865f711df91', 'request_id': 'req-cad46c42-aab9-4a95-aaa9-b797763b717b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:56.666106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952141993af04b9a86c42865f711df91', 'request_id': 'req-cad46c42-aab9-4a95-aaa9-b797763b717b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:56.682353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] The token cache is being invalidate because project 952141993af04b9a86c42865f711df91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:47:56.682767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:56.683589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cad46c42-aab9-4a95-aaa9-b797763b717b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:47:56.695397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 998/1978] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:47:56 2022] DELETE /identity/v3/projects/952141993af04b9a86c42865f711df91 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:56.697600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.698041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.698177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.725053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:56.726303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:56.791895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 981/1979] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:56.800270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.800672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.801061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.822154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:56.825905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:56.836179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 999/1980] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:56.841032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:56.853195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423c84-5320-4dd3-8863-54ab518bb814 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:56.859057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:56.859770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.860076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.860430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.861203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:47:56.861540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:56.863327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:56.877212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 982/1981] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:47:56.881609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:56.892002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a19c-ee3b-4633-9d72-e7a84615f745 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:56.896822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:56.897498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:56.897794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:56.898073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:56.898787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:56.900749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:56.936776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1000/1982] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:56 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:56.937795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:56.948652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb51e-a5bb-4420-bbfb-88cdc25f0976 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.023000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.024010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.024122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.024467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.025709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.027449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.052411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 983/1983] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:56 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:57.055377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.066771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aae200-cc18-4611-9386-73edaa26ef26 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.071933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.072708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.073168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.073536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.074279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.076649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.094097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1001/1984] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:57.094827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.107122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a987-1372-4005-b693-717af574fdb9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.112845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.113678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.114093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.114385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.115173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.116865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e2d87-07e1-4e92-b0cd-8f060d608f12 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.128273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 984/1985] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:47:57.132657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.143766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afa56f-3ffe-43e0-bdfa-074ee020f73d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.148607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.149565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.149921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.150267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] PATH_INFO: `/v3/projects/c4189441261949d182617cb02bb88dd9/users/9bd70c3a14874694bbd736777e10f531/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.166144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4189441261949d182617cb02bb88dd9, user_id=9bd70c3a14874694bbd736777e10f531, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.169461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.197400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1002/1986] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:57 2022] PUT /identity/v3/projects/c4189441261949d182617cb02bb88dd9/users/9bd70c3a14874694bbd736777e10f531/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:57.198695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.198998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.199291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.229270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] MFA Rules not processed for user `9bd70c3a14874694bbd736777e10f531`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:57.230412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:57.237231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:57.353389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 985/1987] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:47:57.357760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.417978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:57.441257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45241f-06e9-4d5f-b8c9-7ebb61b86b0a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.445967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.446634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.447371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.447371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.448004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.450496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.487315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1003/1988] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:47:57 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:47:57.488504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.502234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ce70-7c49-4cb9-98f5-2586f6cd4b87 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.609106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.610087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.610667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.611177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.612107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.614461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.650346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 986/1989] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:47:57 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:47:57.651459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.665536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3cd23-a8ea-4104-a597-8a7d8db39817 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.672124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.672858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.673136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.673417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.674199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.676925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.695578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1004/1990] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:57.700276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.723189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1689ecb-5ca3-4375-b1b8-6b83d42a2297 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.730457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.731817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.732770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.733262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] PATH_INFO: `/v3/projects/19945628c3f7460b9e81b74703fc7b33/users/352246494b3d431a9ecc718e2b66fc91/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.758682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19945628c3f7460b9e81b74703fc7b33, user_id=352246494b3d431a9ecc718e2b66fc91, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.762604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.792055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 987/1991] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:57 2022] PUT /identity/v3/projects/19945628c3f7460b9e81b74703fc7b33/users/352246494b3d431a9ecc718e2b66fc91/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:57.793177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.805775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dccd-06e3-4216-841a-cd793c842961 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.878350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.879248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.879600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.879978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.880942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.889226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a994e-7d94-4e87-9d0c-58e055f16868 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.907060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:57.912975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1005/1992] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:47:57.920341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca0b80-3d9e-46f3-a56a-1659ea01147c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:57.927139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:57.928307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.928772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.929202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] PATH_INFO: `/v3/projects/19945628c3f7460b9e81b74703fc7b33/users/352246494b3d431a9ecc718e2b66fc91/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:57.932271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19945628c3f7460b9e81b74703fc7b33, user_id=352246494b3d431a9ecc718e2b66fc91, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:57.936110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:57.959802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 988/1993] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:47:57 2022] PUT /identity/v3/projects/19945628c3f7460b9e81b74703fc7b33/users/352246494b3d431a9ecc718e2b66fc91/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:47:57.972867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:57.973175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:57.974038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:58.013220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] MFA Rules not processed for user `352246494b3d431a9ecc718e2b66fc91`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:47:58.014634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:58.115035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1006/1994] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:47:58.139865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:47:58.142554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:47:58.249333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95efee-ddc1-439b-af49-640618619db4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:47:58.253899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:47:58.254955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:47:58.255473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:47:58.256059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:47:58.274007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:47:58.358869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:47:58.363573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa740d5-4008-486f-b613-9026269d1017 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:47:58.387779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 989/1995] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:47:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:00.603258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:00.604968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:00.693989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:00.730163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1de2-0c62-4d4d-be20-933b3b437b32 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:00.735469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:00.736391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:00.736674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:00.736951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] PATH_INFO: `/v3/users/f399813ae860481d932f03c109e037f9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:00.738329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f399813ae860481d932f03c109e037f9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:00.740304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:00.807494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f399813ae860481d932f03c109e037f9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:00.810356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f399813ae860481d932f03c109e037f9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:00.821075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f399813ae860481d932f03c109e037f9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:00.841741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f399813ae860481d932f03c109e037f9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:00.855287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f399813ae860481d932f03c109e037f9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:00.864636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1007/1996] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:00 2022] DELETE /identity/v3/users/f399813ae860481d932f03c109e037f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:00.869318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:00.869895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:00.869895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:00.897049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:00.898761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:00.978616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 990/1997] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:00.990073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:00.992860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.053858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059725-fbd6-4980-83b3-2b77f1c471e8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.057690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.058347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.058636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.059456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.070968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.072649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f859c-1e7a-4600-85aa-ce900ddf77ed service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.088738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1008/1998] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:01.154384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.155853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.171401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c664b6c-b64a-416b-baba-c32ab2626767 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.177860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.179087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.179475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.179848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] PATH_INFO: `/v3/users/9bd70c3a14874694bbd736777e10f531` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.181368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd70c3a14874694bbd736777e10f531)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.183519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.240113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd70c3a14874694bbd736777e10f531'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.252858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd70c3a14874694bbd736777e10f531'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.263888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd70c3a14874694bbd736777e10f531'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.275332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd70c3a14874694bbd736777e10f531'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.276417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd70c3a14874694bbd736777e10f531'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.287990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 991/1999] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:01 2022] DELETE /identity/v3/users/9bd70c3a14874694bbd736777e10f531 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:01.293734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.294250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.295425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.315261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:01.316778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.387216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:01.393404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.395229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.408272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1009/2000] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:01.414199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.415230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542def0-0a31-4d82-86ac-c021f3afbf01 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.423019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.423690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.424339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.424631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.424916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] PATH_INFO: `/v3/projects/184fd1677ed4470898f71d3c7edd7a95` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.426308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=184fd1677ed4470898f71d3c7edd7a95)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.428277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.458647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:01.488428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184fd1677ed4470898f71d3c7edd7a95', 'request_id': 'req-774590d5-0a22-4d52-b1ab-62c1b471b2fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.493784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215d47-a644-467c-9744-fc4ce6baf787 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.494161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184fd1677ed4470898f71d3c7edd7a95', 'request_id': 'req-774590d5-0a22-4d52-b1ab-62c1b471b2fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.502003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184fd1677ed4470898f71d3c7edd7a95', 'request_id': 'req-774590d5-0a22-4d52-b1ab-62c1b471b2fa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.515335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] The token cache is being invalidate because project 184fd1677ed4470898f71d3c7edd7a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:01.515710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.516484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-774590d5-0a22-4d52-b1ab-62c1b471b2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.518158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 992/2001] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:01 2022] DELETE /identity/v3/projects/184fd1677ed4470898f71d3c7edd7a95 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:01.523186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb16f3-ab2f-4d03-b74b-9adb516760f3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.523693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb16f3-ab2f-4d03-b74b-9adb516760f3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.524052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb16f3-ab2f-4d03-b74b-9adb516760f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.542472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-40cb16f3-ab2f-4d03-b74b-9adb516760f3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:01.544385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-40cb16f3-ab2f-4d03-b74b-9adb516760f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.546922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.547578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.547974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.548288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.550128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.604142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 993/2002] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:01.612059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.612392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.612670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.614044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.615501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.625867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1010/2003] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:01.630536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:01.631833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.641953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 994/2004] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:01.651287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.662428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.663863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.665419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229fda-2b69-4b1a-90e8-e60752886549 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.672106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.673191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.673555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.673850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.674593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:01.674909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.676656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.678983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c07b7-b51d-41ac-98ac-191cfffdde19 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.684898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.686127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.687071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.687631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] PATH_INFO: `/v3/users/0902f04a7c8440c889d7651d46d48e2f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.689908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1011/2005] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:01.690213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0902f04a7c8440c889d7651d46d48e2f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.692407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.694583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.705880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de661c-4a4a-4e62-aaa6-bb645c264b94 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.711425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.712128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.712460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.712754 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.713449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.716352 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.746551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1012/2006] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:01.751061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0902f04a7c8440c889d7651d46d48e2f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.751305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.765404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0902f04a7c8440c889d7651d46d48e2f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.773534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0902f04a7c8440c889d7651d46d48e2f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.783741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0902f04a7c8440c889d7651d46d48e2f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.784710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53f0299e-257f-4011-b4db-4d2d3df814a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0902f04a7c8440c889d7651d46d48e2f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:01.789502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:01.793831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 995/2007] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:01 2022] DELETE /identity/v3/users/0902f04a7c8440c889d7651d46d48e2f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:01.798739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.799045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.799338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.820080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:01.821764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.836319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed59cb-d0b3-4165-9855-6eb3f0477ddd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:01.837724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:01.903859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 996/2008] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:01.911165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:01.911811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:01.912104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:01.912425 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:01.913850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.915272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:01.917897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:01.921461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:01.971676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1013/2009] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:01 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:01.981949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:01.984476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.002183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b164-fad5-4a43-8ac2-be6d25cda94a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.022462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.023830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.023830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.023830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.024560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.027644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.048518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2e0b1-8fdd-43c7-ac97-f312eb8ee021 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.056964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1014/2010] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:02.057059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.057059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.057059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.057059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.060807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.067384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.068958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.077175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62cef-1215-4b6d-a833-52baf8c0b294 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.102897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.103734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.104040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.104407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.106272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 997/2011] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:02.106392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.106469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.108014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.114120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.145433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c1a4-4b13-4547-8acb-c6cf6b19333f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.145598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1015/2012] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:02.145696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.145696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.145696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.145696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] PATH_INFO: `/v3/projects/c4189441261949d182617cb02bb88dd9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.146127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4189441261949d182617cb02bb88dd9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.147326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.152086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.168421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ba90-9509-4988-bbf0-94fd484cbd15 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.174870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.177363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.177722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.178230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] PATH_INFO: `/v3/projects/937a900e75b4437b85994fce6c1e3ce4/users/0e3dacd75e3a47d9bda05d873826c818/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.201066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937a900e75b4437b85994fce6c1e3ce4, user_id=0e3dacd75e3a47d9bda05d873826c818, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.204448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c173bf6-872a-41c1-bf0f-c72cac132400 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.228372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1016/2013] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:02 2022] PUT /identity/v3/projects/937a900e75b4437b85994fce6c1e3ce4/users/0e3dacd75e3a47d9bda05d873826c818/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:02.230271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.230756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.231316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.241065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4189441261949d182617cb02bb88dd9', 'request_id': 'req-7ac7f4e7-4202-4875-b33f-40430bf18569'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.249532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4189441261949d182617cb02bb88dd9', 'request_id': 'req-7ac7f4e7-4202-4875-b33f-40430bf18569'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.260873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4189441261949d182617cb02bb88dd9', 'request_id': 'req-7ac7f4e7-4202-4875-b33f-40430bf18569'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.263599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:02.266113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.275314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] The token cache is being invalidate because project c4189441261949d182617cb02bb88dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:02.275686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.276329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.293194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 998/2014] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:02 2022] DELETE /identity/v3/projects/c4189441261949d182617cb02bb88dd9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:02.297532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.299252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.354553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1017/2015] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:02.362121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:02.365071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.366641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.395112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f4e7-4202-4875-b33f-40430bf18569 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.405715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:02.406613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.407766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.408119 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.408597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] PATH_INFO: `/v3/users/352246494b3d431a9ecc718e2b66fc91` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.410300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=352246494b3d431a9ecc718e2b66fc91)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.412309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.451063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d3f0-16e0-4cd2-adc0-d944dda42337 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.456104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.456735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.457058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.457369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.468667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352246494b3d431a9ecc718e2b66fc91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.469386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.471073 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.482504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1018/2016] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:02.483735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352246494b3d431a9ecc718e2b66fc91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.492349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352246494b3d431a9ecc718e2b66fc91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.501164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352246494b3d431a9ecc718e2b66fc91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.501903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b9146647-fd4c-4f4c-ba7a-e22422071b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352246494b3d431a9ecc718e2b66fc91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.509817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 999/2017] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:02 2022] DELETE /identity/v3/users/352246494b3d431a9ecc718e2b66fc91 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:02.578567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.581752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.601550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1305-fffe-4afd-9be6-532a2c49f0de service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.670971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.673000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.673513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.673992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] PATH_INFO: `/v3/projects/ab1242fb43cd4a558d00b1750834a113` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.675602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1242fb43cd4a558d00b1750834a113)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.678764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.748998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1242fb43cd4a558d00b1750834a113', 'request_id': 'req-57318604-ae38-42aa-a49c-e1e8db05b00f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.758154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1242fb43cd4a558d00b1750834a113', 'request_id': 'req-57318604-ae38-42aa-a49c-e1e8db05b00f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.765495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1242fb43cd4a558d00b1750834a113', 'request_id': 'req-57318604-ae38-42aa-a49c-e1e8db05b00f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.778187 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] The token cache is being invalidate because project ab1242fb43cd4a558d00b1750834a113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:02.778553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.779157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-57318604-ae38-42aa-a49c-e1e8db05b00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:02.780787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1019/2018] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:02 2022] DELETE /identity/v3/projects/ab1242fb43cd4a558d00b1750834a113 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:02.785688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e735-6179-44a5-89ec-0142168571cc None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.785989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e735-6179-44a5-89ec-0142168571cc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.786274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e735-6179-44a5-89ec-0142168571cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.805842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6965e735-6179-44a5-89ec-0142168571cc None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:02.807071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6965e735-6179-44a5-89ec-0142168571cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.872379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1000/2019] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:02.880127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210164-d033-4285-9399-1b425296db55 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.880448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210164-d033-4285-9399-1b425296db55 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.880752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210164-d033-4285-9399-1b425296db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.899340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-79210164-d033-4285-9399-1b425296db55 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:02.900664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-79210164-d033-4285-9399-1b425296db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:02.909554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1020/2020] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:02.914166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965e735-6179-44a5-89ec-0142168571cc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.926022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965e735-6179-44a5-89ec-0142168571cc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.930867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.931545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.931838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.932123 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.932977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:02.933494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.935862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:02.951803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1001/2021] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:02.953319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210164-d033-4285-9399-1b425296db55 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:02.962722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210164-d033-4285-9399-1b425296db55 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:02.968711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:02.969346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:02.969742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:02.970122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:02.970929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:02.972973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265877b-94c1-44b7-941e-3259e98fbacc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.015875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1021/2022] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:02 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:03.016997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.028553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b14c-dbe3-4fd5-ba0c-1a6b953a58ab admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.029211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1317-b26b-4770-b7b2-c1feec4f8a1f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.029674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1317-b26b-4770-b7b2-c1feec4f8a1f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.029954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1317-b26b-4770-b7b2-c1feec4f8a1f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.031759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1022/2023] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 13:48:03.079054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:03.081730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b021de-9301-4274-b052-4d7b874da081 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.081910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b021de-9301-4274-b052-4d7b874da081 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.082207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b021de-9301-4274-b052-4d7b874da081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.100380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.101365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.101572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.101806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.102512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.104645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.119492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f2b021de-9301-4274-b052-4d7b874da081 None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:03.121367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2b021de-9301-4274-b052-4d7b874da081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:03.131524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1002/2024] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:03 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:03.135410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.147740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c95f-25d9-4ffa-b4c2-7c1b128bb225 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.148885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:03.155959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.156681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.156969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.157246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.158038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.159680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.176656 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1003/2025] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:03.177721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.190463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547349-2d3a-45e9-8322-8470789608f3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.198412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.199279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.200102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.200102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.201031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.202808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.222212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1004/2026] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:03.223850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.228551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1023/2027] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:03.235068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027495a-0d6b-4a86-a3c1-8265b4ca2c6a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.239968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.240976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.241881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.242237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] PATH_INFO: `/v3/projects/02ebe4c18b244cfe95cf8a13b3c1a9b2/users/bb60ae7052fb4163a444bb8c95f09230/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.260432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ebe4c18b244cfe95cf8a13b3c1a9b2, user_id=bb60ae7052fb4163a444bb8c95f09230, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.263481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.284284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1005/2028] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:03 2022] PUT /identity/v3/projects/02ebe4c18b244cfe95cf8a13b3c1a9b2/users/bb60ae7052fb4163a444bb8c95f09230/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:03.295013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.295362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.295581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.299070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.303049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:03.349862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] MFA Rules not processed for user `bb60ae7052fb4163a444bb8c95f09230`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:03.352262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:03.430381 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbba83-b9e4-4d49-8e8a-ebc8acb0e473 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.452722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.454346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.454812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.456668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.463850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1024/2029] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:03.480467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.483760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:03.487179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.494214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.520876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1006/2030] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:03.582833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924824b-0870-49a9-a2fa-c2144f36855c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.586673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.587327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.587615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.587892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.598703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.600153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aefed-aa60-4ea9-95af-fb26947e6df2 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.607951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:03.610028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:03.611988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1025/2031] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:03.745252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5da6e-94d7-4fb3-8730-9ed6df5e690a service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:03.751995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:03.753009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.753231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.753882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] PATH_INFO: `/v3/projects/19945628c3f7460b9e81b74703fc7b33` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.756258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19945628c3f7460b9e81b74703fc7b33)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:03.758399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:03.825642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:03.873661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19945628c3f7460b9e81b74703fc7b33', 'request_id': 'req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:03.874188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b87d8-e1ac-4e99-a94a-1a0c600a193e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.875218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b87d8-e1ac-4e99-a94a-1a0c600a193e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.875777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b87d8-e1ac-4e99-a94a-1a0c600a193e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.878117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1026/2032] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:48:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:48:03.880139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19945628c3f7460b9e81b74703fc7b33', 'request_id': 'req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:03.893338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19945628c3f7460b9e81b74703fc7b33', 'request_id': 'req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:03.909966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] The token cache is being invalidate because project 19945628c3f7460b9e81b74703fc7b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:03.910422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:03.911909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ed9fa1c0-c827-4d12-88fb-b38e9df6828f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:03.919646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1007/2033] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:03 2022] DELETE /identity/v3/projects/19945628c3f7460b9e81b74703fc7b33 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:03.920318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b987-c37e-492c-bd3f-9d7e6dffa2c9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:03.920318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b987-c37e-492c-bd3f-9d7e6dffa2c9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:03.920584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b987-c37e-492c-bd3f-9d7e6dffa2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:03.950213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7654b987-c37e-492c-bd3f-9d7e6dffa2c9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:03.951502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7654b987-c37e-492c-bd3f-9d7e6dffa2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.052586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:04.077611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1027/2034] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:04.080333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.080788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.084728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.119928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.120477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.120935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.150401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:04.164104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] MFA Rules not processed for user `1777a8169cdc435481082952d2fbefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:04.165394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.169742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.195642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1008/2035] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:04.199035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.226491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b2502-51fe-417a-8374-f05c9e829599 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.233315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.234095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.234468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.235007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.236645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:04.237072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.239473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.275519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1009/2036] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:04.277164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.280819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.303792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36b10-c7fc-48b9-bf02-223ca2ae431d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.308427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1028/2037] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:04.309625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.313863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.316176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.316334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.316523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] PATH_INFO: `/v3/users/b3f5d64a2da7404caf01de004fa841a7` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.325758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f5d64a2da7404caf01de004fa841a7)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.326494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff679-0dbb-411d-bbd0-79ca5e374faf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.332300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.333039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.333468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.333824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.334601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.335552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.336685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.375826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1029/2038] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:04 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:04.375826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.378298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.401548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f5d64a2da7404caf01de004fa841a7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:04.420129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f5d64a2da7404caf01de004fa841a7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:04.428553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f5d64a2da7404caf01de004fa841a7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:04.441138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f5d64a2da7404caf01de004fa841a7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:04.442200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f5d64a2da7404caf01de004fa841a7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:04.449135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1010/2039] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:04 2022] DELETE /identity/v3/users/b3f5d64a2da7404caf01de004fa841a7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:04.450586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.451934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.477151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68c35-c99b-4ee7-bdbb-4653e86548f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.551754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e83973-b50d-422e-bb36-8b82f5ea30d1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.560321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.561061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.561354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.561621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.562347 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.564533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.583673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:04.603538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.605729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.606020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.606298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.614739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1011/2040] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:04 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:04.615515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.617007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.635705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.637844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.640966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aebdf-7885-43cb-bde0-cbf6d6c9b6e4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.664043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1030/2041] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:04.669567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.670430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.670732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.671025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.671840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.673616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.708255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1012/2042] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:04.713111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.720908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:04.729922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4bf04-9267-4206-9630-ab75e12d1622 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.741991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.742994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.743435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.743807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.744828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.747678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18fd0-b4bb-4c4f-9adc-04596dc51791 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.761455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1031/2043] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:04.765795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.782524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9b35-9542-40f1-b67f-0f2772e905ff admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.794551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b022a-66cc-4ac6-bac3-516dbcd1bbe2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.794967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b022a-66cc-4ac6-bac3-516dbcd1bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.795344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b022a-66cc-4ac6-bac3-516dbcd1bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.796978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.798025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.798333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.798697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] PATH_INFO: `/v3/projects/accaa16554cb41678c9df626e8e61dca/users/659802c1de6d421ca4d8d635fceb00e2/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.835494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accaa16554cb41678c9df626e8e61dca, user_id=659802c1de6d421ca4d8d635fceb00e2, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.839878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:04.861693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1013/2044] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:04 2022] PUT /identity/v3/projects/accaa16554cb41678c9df626e8e61dca/users/659802c1de6d421ca4d8d635fceb00e2/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:04.863575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:04.866101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.881462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-946b022a-66cc-4ac6-bac3-516dbcd1bbe2 None None] MFA Rules not processed for user `0e3dacd75e3a47d9bda05d873826c818`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:04.882936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-946b022a-66cc-4ac6-bac3-516dbcd1bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:04.967833 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670a598-1d61-48fb-949d-9e80fc6d4e99 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:04.975955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:04.977152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:04.977445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:04.978019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] PATH_INFO: `/v3/projects/68a4c6feb1344171a4e3b90f3fa1bb04` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:04.979613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a4c6feb1344171a4e3b90f3fa1bb04)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:04.982109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.001513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1032/2045] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:05.004937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.004937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.004937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.048156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] MFA Rules not processed for user `659802c1de6d421ca4d8d635fceb00e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:05.049681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.051620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a4c6feb1344171a4e3b90f3fa1bb04', 'request_id': 'req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.059409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a4c6feb1344171a4e3b90f3fa1bb04', 'request_id': 'req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.069767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a4c6feb1344171a4e3b90f3fa1bb04', 'request_id': 'req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.083133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] The token cache is being invalidate because project 68a4c6feb1344171a4e3b90f3fa1bb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:05.083443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.084217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.085853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1014/2046] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:04 2022] DELETE /identity/v3/projects/68a4c6feb1344171a4e3b90f3fa1bb04 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:05.089252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.089252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.127021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1033/2047] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:05.129222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.130713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.147239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:05.151273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db75cf-2fdf-4f7d-89ad-5619b2e83b4e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.156705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.157544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.157998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.158400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.160466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.197688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1d3f-7431-4c09-9f11-8e8ce587eaf3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.202393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.203617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.203907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.204216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] PATH_INFO: `/v3/users/c470843cdc3740eb81f3c7e5c53c77f2` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.205469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c470843cdc3740eb81f3c7e5c53c77f2)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.207409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.222182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:05.223481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.224981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.235997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1015/2048] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:05.236879 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.238314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.253755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd417-1c14-4229-8561-daa399af13db service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.261265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.262460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.262717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.263002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.263665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.265047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c470843cdc3740eb81f3c7e5c53c77f2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.265621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.266024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c470843cdc3740eb81f3c7e5c53c77f2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.276921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c470843cdc3740eb81f3c7e5c53c77f2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.296460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c470843cdc3740eb81f3c7e5c53c77f2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.315390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c470843cdc3740eb81f3c7e5c53c77f2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.344334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1034/2049] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:05 2022] DELETE /identity/v3/users/c470843cdc3740eb81f3c7e5c53c77f2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:05.360875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1016/2050] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:05.376757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.378926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.526653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2d644-89e1-47b0-aaf8-e7002b53c7fd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.533455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.534338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.534777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.535206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.537045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.539413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.566598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1035/2051] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:05.571894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.639099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.641903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.664399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62f65-d6f8-4b63-b444-b7ce928d94f5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.684990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.685782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.687119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.687456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] PATH_INFO: `/v3/projects/9e51190dfac84800a57697b393b909c5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.688997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e51190dfac84800a57697b393b909c5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.691950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.719684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608d67-d296-487f-8654-c2b2f85056b0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.733452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.733452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.733452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.733871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.734551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.736212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.753920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1017/2052] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:05.758102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.769409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91d55-af7d-4727-acdc-df341701cf53 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.788052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e51190dfac84800a57697b393b909c5', 'request_id': 'req-29e445bb-746c-4fc6-b596-cb2983411786'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.798001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e51190dfac84800a57697b393b909c5', 'request_id': 'req-29e445bb-746c-4fc6-b596-cb2983411786'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.804930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e51190dfac84800a57697b393b909c5', 'request_id': 'req-29e445bb-746c-4fc6-b596-cb2983411786'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.831586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] The token cache is being invalidate because project 9e51190dfac84800a57697b393b909c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:05.831989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.833087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-29e445bb-746c-4fc6-b596-cb2983411786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:05.836252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1036/2053] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:05 2022] DELETE /identity/v3/projects/9e51190dfac84800a57697b393b909c5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:05.840609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2735-5682-428e-b1cc-fc5983a28b99 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.840972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2735-5682-428e-b1cc-fc5983a28b99 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.841302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2735-5682-428e-b1cc-fc5983a28b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.851347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:05.852459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.853145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.853433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.853827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.854431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.857668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.871601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1018/2054] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:05.881606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.881860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9fcf2735-5682-428e-b1cc-fc5983a28b99 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:05.884326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9fcf2735-5682-428e-b1cc-fc5983a28b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.884811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.896270 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1037/2055] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:05.899268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be89a83-5d75-4b61-9622-eae2f3db9db6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.905060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.905335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.905617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.905843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:05.906984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.907334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.907704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] PATH_INFO: `/v3/projects/3a2e37632acb4931accb1e9a26144afd/users/9a26594102344ea09618f6f580327a45/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.921220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:05.926520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2e37632acb4931accb1e9a26144afd, user_id=9a26594102344ea09618f6f580327a45, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:05.928693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:05.929796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2286-e486-427c-a74c-a6c0e1cf756a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:05.929984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:05.940479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1038/2056] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:05.944643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:05.949080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1019/2057] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:05 2022] PUT /identity/v3/projects/3a2e37632acb4931accb1e9a26144afd/users/9a26594102344ea09618f6f580327a45/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:05.954740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a696bf-74bf-4bd0-be2f-1012ddd27815 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:05.960929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:05.961298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:05.961751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:05.990737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] MFA Rules not processed for user `9a26594102344ea09618f6f580327a45`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:05.991990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.017481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.018161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.018515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.018802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.019619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:06.019862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.021545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.036911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1039/2058] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:48:06.041207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.052039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d116a5-b03f-4f9c-8c01-9c8d47638608 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.057056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.058117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.058416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.059239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.059942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.061978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.073453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1020/2059] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:06.078434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.091488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1040/2060] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:06.091731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a2fb2-5e2a-4aa8-b91c-1ece9e92fa14 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.096280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.164089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.164860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.165155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.165444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.166155 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.168371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.169528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918faa68-48e6-44d3-9bca-85527f6b5810 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.174199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.174888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.175176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.175461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.176722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.179075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.209759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1041/2061] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:06.211196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.211783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1021/2062] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:06.212954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.222182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7961d-9638-47f0-849b-0b6ad30553ea admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.270809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:06.277542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c96bf-6925-4ddc-bfaa-9646219e05ab admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.281735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.282426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.282660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.282781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.282990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.283397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.283715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.283814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.284032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.284861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.285367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.286831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.295399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1042/2063] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:06.296343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:06.299611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.310655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1022/2064] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:06.310894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431bec-89c4-4733-95a3-17c87dca3fd2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.314487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.315690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.316384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.316677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.316963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.317694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.319297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.323956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f36b-9292-4b56-809d-f117e12ac0ef admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.329426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.330104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.330388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.330666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.331389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.331663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1043/2065] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:06.333022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.335734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.343642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1023/2066] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:06.346389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ced1cf-7284-418c-825a-6912d710c834 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.347967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.351792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.352693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.353004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.353280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] PATH_INFO: `/v3/projects/36ea2a28122045f9bc73bcd38d2e50e9/users/b76b74e1640640139dfb6be55fc7925b/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.358680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133144-b341-495c-ad73-03fba09b143d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.363714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.364764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.365142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.365346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] PATH_INFO: `/v3/projects/078b3b0a95394fc2802d8bca668ca754/users/97ca89771d864d7cb6bd8ae184e24515/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.369178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ea2a28122045f9bc73bcd38d2e50e9, user_id=b76b74e1640640139dfb6be55fc7925b, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.372301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56650c-1901-43dc-a597-17323860b93b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.384124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078b3b0a95394fc2802d8bca668ca754, user_id=97ca89771d864d7cb6bd8ae184e24515, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.387760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1044/2067] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:06 2022] PUT /identity/v3/projects/36ea2a28122045f9bc73bcd38d2e50e9/users/b76b74e1640640139dfb6be55fc7925b/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:06.388349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.397885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.398192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.398512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.407099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1024/2068] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:06 2022] PUT /identity/v3/projects/078b3b0a95394fc2802d8bca668ca754/users/97ca89771d864d7cb6bd8ae184e24515/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:06.411731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.430763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] MFA Rules not processed for user `b76b74e1640640139dfb6be55fc7925b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:06.432000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.478910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060c06-270a-48d6-8271-67866d1dc539 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.484361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.485028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.485567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.485860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.486630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.488265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.502212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1025/2069] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:06.502400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1045/2070] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:06.505412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.512468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.513939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.515696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90920e4-49f2-4fdc-8603-e8a2ae6a1bb3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.520965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.521840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.522126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.522401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] PATH_INFO: `/v3/projects/078b3b0a95394fc2802d8bca668ca754/users/97ca89771d864d7cb6bd8ae184e24515/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.524528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=078b3b0a95394fc2802d8bca668ca754, user_id=97ca89771d864d7cb6bd8ae184e24515, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.527277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a66e-9ed4-4147-9b01-24c2bf7d9b9d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.538489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1026/2071] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:06 2022] PUT /identity/v3/projects/078b3b0a95394fc2802d8bca668ca754/users/97ca89771d864d7cb6bd8ae184e24515/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:06.549139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.549433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.549715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.572171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a21d-bba7-476e-b701-dc96f3f3217f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.576166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] MFA Rules not processed for user `97ca89771d864d7cb6bd8ae184e24515`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:06.577426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.623560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.624134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.624455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.624744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.634324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:06.663080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1027/2072] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:06.674607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:06.676067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.684561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.686009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380397-4304-4e53-aa62-c86089de64e7 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.687585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904f927-feb3-4d92-ad75-2cf3724dfb34 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:06.691792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:06.692461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:06.692753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:06.693035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:06.694787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:06.694990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1046/2073] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:06.721820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:06.757532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:06.759084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:06.768283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1028/2074] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:07.013346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:07.013863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:07.014125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:07.034159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] MFA Rules not processed for user `0e3dacd75e3a47d9bda05d873826c818`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:07.046184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:07.119426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1047/2075] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:08.322210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:08.331654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b4720-c88e-4683-a31d-da687522a226 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:08.335526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:08.336162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:08.336495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:08.336778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:08.399492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:08.401836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:08.416645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1029/2076] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:09.984413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:09.994721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd01346-e8ac-48b4-9634-56971a2d2526 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:09.999011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:09.999682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:09.999979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:10.000320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:10.009545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:10.010982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80167c6-c15f-400b-b856-8290eaa9a886 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:10.021277 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1048/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:17.039306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:17.112616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5e9de-a336-495d-9141-11583252e292 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:17.119108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:17.120132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:17.120454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:17.121387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] PATH_INFO: `/v3/users/659802c1de6d421ca4d8d635fceb00e2` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:17.122651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=659802c1de6d421ca4d8d635fceb00e2)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:17.125263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:17.213625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659802c1de6d421ca4d8d635fceb00e2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.234891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659802c1de6d421ca4d8d635fceb00e2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.236536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:17.246871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659802c1de6d421ca4d8d635fceb00e2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.257719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659802c1de6d421ca4d8d635fceb00e2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.259049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659802c1de6d421ca4d8d635fceb00e2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.269163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1030/2078] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:17 2022] DELETE /identity/v3/users/659802c1de6d421ca4d8d635fceb00e2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:17.272087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:17.272602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:17.272694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:17.295881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:17.297148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:17.391068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1049/2079] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:17.404009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:17.405467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:17.478185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c12901-27f5-4379-94de-3be48398f2ef admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:17.482055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:17.482719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:17.483057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:17.483343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:17.495136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:17.497240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f1cc9-809b-430a-8e1a-34406d006c39 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:17.508105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1031/2080] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:17.657312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:17.659275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:17.672888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc4e9b-fc69-4409-81b5-b8926250943e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:17.678982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:17.679805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:17.680155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:17.680419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] PATH_INFO: `/v3/users/bb60ae7052fb4163a444bb8c95f09230` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:17.681828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb60ae7052fb4163a444bb8c95f09230)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:17.683664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:17.763095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:17.774197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb60ae7052fb4163a444bb8c95f09230'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.776841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb60ae7052fb4163a444bb8c95f09230'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.792154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb60ae7052fb4163a444bb8c95f09230'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.811137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb60ae7052fb4163a444bb8c95f09230'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.825847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb60ae7052fb4163a444bb8c95f09230'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:17.836250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1050/2081] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:17 2022] DELETE /identity/v3/users/bb60ae7052fb4163a444bb8c95f09230 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:17.841018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:17.841314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:17.841588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:17.872820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:17.877237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:17.990530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1032/2082] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:18.002893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:18.004541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:18.096901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a8b7-ae79-4c31-8d6f-d09d1d6c3633 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:18.100882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:18.101564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.101849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.102122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:18.118348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:18.119888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:18.132075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1051/2083] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:18.334492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:18.337456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:18.381226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813478-fb93-4acd-a25d-eed22962c79f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:18.397384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:18.399483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.399804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.403396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] PATH_INFO: `/v3/projects/accaa16554cb41678c9df626e8e61dca` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:18.405695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accaa16554cb41678c9df626e8e61dca)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:18.407901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:18.523957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accaa16554cb41678c9df626e8e61dca', 'request_id': 'req-d9ec9f08-364d-4753-9612-11dd382c2c10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.535689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accaa16554cb41678c9df626e8e61dca', 'request_id': 'req-d9ec9f08-364d-4753-9612-11dd382c2c10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.547385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accaa16554cb41678c9df626e8e61dca', 'request_id': 'req-d9ec9f08-364d-4753-9612-11dd382c2c10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.597679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] The token cache is being invalidate because project accaa16554cb41678c9df626e8e61dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:18.597988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.598676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.603407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1033/2084] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:18 2022] DELETE /identity/v3/projects/accaa16554cb41678c9df626e8e61dca => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:18.604583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:18.606591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:18.616405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:18.618283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:18.629378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258950-ff30-4445-b80c-dd3411be10e5 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:18.647061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:18.728492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:18.730537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.730935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.731220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] PATH_INFO: `/v3/projects/02ebe4c18b244cfe95cf8a13b3c1a9b2` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:18.733537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ebe4c18b244cfe95cf8a13b3c1a9b2)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:18.736726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:18.739659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec9f08-364d-4753-9612-11dd382c2c10 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:18.745277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:18.747214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.747214 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.747446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] PATH_INFO: `/v3/users/9a26594102344ea09618f6f580327a45` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:18.748597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a26594102344ea09618f6f580327a45)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:18.751191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:18.818562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a26594102344ea09618f6f580327a45'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.818890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ebe4c18b244cfe95cf8a13b3c1a9b2', 'request_id': 'req-e550252d-4c58-4527-a937-25654c616829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.829542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ebe4c18b244cfe95cf8a13b3c1a9b2', 'request_id': 'req-e550252d-4c58-4527-a937-25654c616829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.835103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a26594102344ea09618f6f580327a45'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.835282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:18.838105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ebe4c18b244cfe95cf8a13b3c1a9b2', 'request_id': 'req-e550252d-4c58-4527-a937-25654c616829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.847050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a26594102344ea09618f6f580327a45'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.856671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a26594102344ea09618f6f580327a45'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.857315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f38d6a1c-f233-458f-82d9-b1238f45d5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a26594102344ea09618f6f580327a45'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.857916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] The token cache is being invalidate because project 02ebe4c18b244cfe95cf8a13b3c1a9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:18.858295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.859152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e550252d-4c58-4527-a937-25654c616829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:18.864141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1052/2085] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:18 2022] DELETE /identity/v3/projects/02ebe4c18b244cfe95cf8a13b3c1a9b2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:18.864991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1034/2086] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:18 2022] DELETE /identity/v3/users/9a26594102344ea09618f6f580327a45 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:18.872096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.872419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.872704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:18.893664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:18.895043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:18.969807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1053/2087] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:18.979319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d124e-221d-4085-a831-95d223ad998c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:18.979792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d124e-221d-4085-a831-95d223ad998c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:18.980513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d124e-221d-4085-a831-95d223ad998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.014984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b46d124e-221d-4085-a831-95d223ad998c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:19.016360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b46d124e-221d-4085-a831-95d223ad998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:19.026696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1035/2088] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:19.032925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.049235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e577469-19a2-40dd-b2d7-d512e2f9d43d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.059752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.061237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.061907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.062458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.063853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:19.064490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.066770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.084731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1054/2089] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:19.089663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d124e-221d-4085-a831-95d223ad998c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.099836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d124e-221d-4085-a831-95d223ad998c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.104925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.106127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.106417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.106700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.107443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.109422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.142401 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1036/2090] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:19 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:19.143199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.153616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7611ad-3dab-4c94-a7ca-1f554402c6e6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.224159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.225052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.225597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.226133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.226984 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.229229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.263927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.265289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1055/2091] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:19 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:19.277893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7a30-c17c-452e-bdf7-8e5ba5e8cfea admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.283885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.284620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.284955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.285459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.286077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.287982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.303215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1037/2092] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:19.306992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.321177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94316ef-d77f-4c6b-bb2d-9da2d2fa1076 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.327023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.327705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.328946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.328946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.329584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.332134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.344291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1056/2093] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:19.347794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.348280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.350193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:19.364860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7323-0726-4648-b4e5-60795bf1472a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.372363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a001-33a4-4338-af34-f74a846dd622 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.378089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.379682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.380290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.383227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] PATH_INFO: `/v3/projects/3a2e37632acb4931accb1e9a26144afd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.384904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2e37632acb4931accb1e9a26144afd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.387768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.405520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.420637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.422349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.422726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] PATH_INFO: `/v3/projects/1ddc6ae060994d16b13ff53e80813e83/users/a3e5180dc37741919bc068f5e2302850/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.445150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ddc6ae060994d16b13ff53e80813e83, user_id=a3e5180dc37741919bc068f5e2302850, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.449962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d8a5-8296-4188-a2bd-9efd79dc7e9e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.451192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:19.463330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2e37632acb4931accb1e9a26144afd', 'request_id': 'req-a0424f4b-7be3-4c4f-b73a-d529508e26ef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.472572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1057/2094] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:19 2022] PUT /identity/v3/projects/1ddc6ae060994d16b13ff53e80813e83/users/a3e5180dc37741919bc068f5e2302850/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:19.477658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2e37632acb4931accb1e9a26144afd', 'request_id': 'req-a0424f4b-7be3-4c4f-b73a-d529508e26ef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.478253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.479125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.479125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.487899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2e37632acb4931accb1e9a26144afd', 'request_id': 'req-a0424f4b-7be3-4c4f-b73a-d529508e26ef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.499716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:19.501262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:19.505567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] The token cache is being invalidate because project 3a2e37632acb4931accb1e9a26144afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:19.505963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.506813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.512250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1038/2095] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:19 2022] DELETE /identity/v3/projects/3a2e37632acb4931accb1e9a26144afd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:19.515199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.517110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:19.537921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:19.589432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1058/2096] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:19.599464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:19.601230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:19.603686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0424f4b-7be3-4c4f-b73a-d529508e26ef admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.609597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.610292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.610631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.610925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] PATH_INFO: `/v3/users/97ca89771d864d7cb6bd8ae184e24515` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.612254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ca89771d864d7cb6bd8ae184e24515)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.614342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.681047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9d095-93d3-4d6d-ab8e-2680124b7546 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:19.681047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:19.681047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:19.681047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:19.681649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:19.694828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:19.700312 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:19.706961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ca89771d864d7cb6bd8ae184e24515'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.722175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1059/2097] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:19.732520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ca89771d864d7cb6bd8ae184e24515'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.738961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ca89771d864d7cb6bd8ae184e24515'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.753070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ca89771d864d7cb6bd8ae184e24515'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.753882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6270dcb3-9fb0-44d3-ba9f-8fb3562f27d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ca89771d864d7cb6bd8ae184e24515'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:19.790588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1039/2098] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:19 2022] DELETE /identity/v3/users/97ca89771d864d7cb6bd8ae184e24515 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:20.334646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.355295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f18c3b-f1b7-4f40-8996-f59c716efa7a service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.423765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.424741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.425885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.426265 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] PATH_INFO: `/v3/projects/078b3b0a95394fc2802d8bca668ca754` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.427426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=078b3b0a95394fc2802d8bca668ca754)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.429863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.483127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078b3b0a95394fc2802d8bca668ca754', 'request_id': 'req-b5a5560e-09ca-4b56-a208-808edf59b49e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:20.490970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078b3b0a95394fc2802d8bca668ca754', 'request_id': 'req-b5a5560e-09ca-4b56-a208-808edf59b49e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:20.498416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078b3b0a95394fc2802d8bca668ca754', 'request_id': 'req-b5a5560e-09ca-4b56-a208-808edf59b49e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:20.510479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.510939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.511256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.520602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] The token cache is being invalidate because project 078b3b0a95394fc2802d8bca668ca754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:20.520912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:20.521551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b5a5560e-09ca-4b56-a208-808edf59b49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:20.523383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1060/2099] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:20 2022] DELETE /identity/v3/projects/078b3b0a95394fc2802d8bca668ca754 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:20.528362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e1ef-e715-4750-8491-aa9d9b9318ae None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.528653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e1ef-e715-4750-8491-aa9d9b9318ae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.529095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e1ef-e715-4750-8491-aa9d9b9318ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.538278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:20.546299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] MFA Rules not processed for user `a3e5180dc37741919bc068f5e2302850`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:20.547556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:20.560823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5759e1ef-e715-4750-8491-aa9d9b9318ae None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:20.562055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5759e1ef-e715-4750-8491-aa9d9b9318ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:20.601579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:20.641146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1040/2100] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:20.655865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.658222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:20.659470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1061/2101] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:20.669005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.669294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.669771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.690215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:20.692151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:20.705177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1062/2102] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:20.706424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.718375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412e74-6d0b-4399-bb66-ea135221f269 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.723848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.724566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.724850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.725134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.725872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:20.726184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.727965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.738065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a808-0482-42cd-af67-dc3f4172e584 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.741820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.742481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.742847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.743138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.744366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1063/2103] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:20.746271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.752104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.753600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.755802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ff14-c0d0-49ba-a7d7-24b2a5d319d3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.760572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.761736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.762027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.762309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.762995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.763761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1041/2104] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:20.764931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.793819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1064/2105] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:20 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:20.795384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.806840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1d9b-7e2f-44c4-861c-a4b43932f5f6 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.866221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.866819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.867108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.867385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.868076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.870059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.893960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1042/2106] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:20 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:20.895475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.906739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1f18-3876-4a7d-88b2-36da8874e5ca admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.912016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.912899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.913399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.913860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.914763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.916885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.940892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1065/2107] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:20.942268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.953888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6900d-ae44-4704-ba85-f640d761fdcd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.958811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.959582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:20.959939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:20.960259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:20.961016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:20.962641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877160b8-371b-4168-a0ee-a7fde535e73c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:20.974786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1043/2108] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:20.978987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:20.990120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede84b-2e45-433d-a405-492afdd3bea1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:20.996662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:20.997685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:21.007342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:21.007342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] PATH_INFO: `/v3/projects/c351b8ccf2ff4c73af26732ae16ac582/users/33ffc8aa33444926afae18059a6af753/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:21.022064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c351b8ccf2ff4c73af26732ae16ac582, user_id=33ffc8aa33444926afae18059a6af753, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:21.024897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:21.039644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1066/2109] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:20 2022] PUT /identity/v3/projects/c351b8ccf2ff4c73af26732ae16ac582/users/33ffc8aa33444926afae18059a6af753/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:21.049817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678726dd-d5da-4d12-9080-1fb7c26a3d44 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:21.050222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678726dd-d5da-4d12-9080-1fb7c26a3d44 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:21.050375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678726dd-d5da-4d12-9080-1fb7c26a3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:21.083727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-678726dd-d5da-4d12-9080-1fb7c26a3d44 None None] MFA Rules not processed for user `33ffc8aa33444926afae18059a6af753`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:21.085277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-678726dd-d5da-4d12-9080-1fb7c26a3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:21.164049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:21.182307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1044/2110] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:21.202065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:21.204108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:21.282619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b745e-42c3-4f04-b143-91711c645f84 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:21.286800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:21.287456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:21.287743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:21.288020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:21.299067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:21.300567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:21.311611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1067/2111] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:24.251564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:24.252161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:24.252161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:24.285059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] MFA Rules not processed for user `a3e5180dc37741919bc068f5e2302850`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:24.286302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:24.397364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1045/2112] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:25.591459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:25.593315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:25.612341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:25.687688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96184-00a2-4de2-b590-abc3b10ca96a service glance] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:25.699651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:25.700922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:25.701210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:25.701848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] PATH_INFO: `/v3/users/419fced725134a31bee9907051f2621b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:25.703534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419fced725134a31bee9907051f2621b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:25.706335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:25.801420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419fced725134a31bee9907051f2621b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:25.802510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419fced725134a31bee9907051f2621b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:25.811447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419fced725134a31bee9907051f2621b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:25.843313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419fced725134a31bee9907051f2621b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:25.851916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84ff299b-4e4c-47aa-870d-481a0e4fe919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419fced725134a31bee9907051f2621b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:25.860832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1068/2113] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:25 2022] DELETE /identity/v3/users/419fced725134a31bee9907051f2621b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:26.217931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.233804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16bd9-d4f4-433c-ae22-dcb5d374f3ff None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.303920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.304821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.305111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.305396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] PATH_INFO: `/v3/projects/f4d1a070c0624b1e9e0b12d5eb0cb0b5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.306592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d1a070c0624b1e9e0b12d5eb0cb0b5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.309226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.363151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'request_id': 'req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:26.370954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'request_id': 'req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:26.382125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d1a070c0624b1e9e0b12d5eb0cb0b5', 'request_id': 'req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:26.396224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] The token cache is being invalidate because project f4d1a070c0624b1e9e0b12d5eb0cb0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:26.396745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:26.400539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4f4e0c8f-313b-4f82-aebe-abf77e9c4209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:26.402628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1046/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:26 2022] DELETE /identity/v3/projects/f4d1a070c0624b1e9e0b12d5eb0cb0b5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:26.409219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.409653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.409958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.438587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:26.440271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:26.505693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1069/2115] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:26.514390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.514686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.514971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.533812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:26.535033 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:26.543626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1047/2116] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:26.548593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.559959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad8e16-7854-45a3-8ecf-9161ca3d94ba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.565346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.566015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.566308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.566590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.567325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:26.567637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.569383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.582214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1070/2117] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:48:26.586789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.597535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087cf5-93da-47b7-bf1a-bca17fe0f716 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.602274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.602934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.603226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.603509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.604301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.606937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.627802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:26.640587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1048/2118] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:26 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:26.642319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.659985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f0a47-c462-4a31-a957-395e8d868eef admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.672816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:26.718959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.719616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.719901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.720175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.720893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.722809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.741936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1071/2119] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:26 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:26.746584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.757277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e72d-7b84-4c33-927a-706581adb8a5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.762545 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.763211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.763496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.763772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.764537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.766832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.778143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1049/2120] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:26.782316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.792238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5c12-2fc5-459a-8423-6cb8947823ce admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.796925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.797594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.797882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.798160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.798889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.800536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824483-6b89-4c64-80be-eee48fc77ecb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.811608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1072/2121] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:26.816020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:26.828167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd22206-f00d-4907-9399-a7d1d56bdc4f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:26.833779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:26.834771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.835131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.835481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] PATH_INFO: `/v3/projects/125a038c446947eda44845b495bb6a4d/users/0c2c74c32db0435084b149d7926c8c81/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.861589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125a038c446947eda44845b495bb6a4d, user_id=0c2c74c32db0435084b149d7926c8c81, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:26.866149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:26.898015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1050/2122] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:26 2022] PUT /identity/v3/projects/125a038c446947eda44845b495bb6a4d/users/0c2c74c32db0435084b149d7926c8c81/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:26.912495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:26.912924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:26.913289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:26.958440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] MFA Rules not processed for user `0c2c74c32db0435084b149d7926c8c81`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:26.961094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:27.094951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1073/2123] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:27.107619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:27.110371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:27.247649 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68419830-49f9-4188-83a1-ab35811f3ee4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:27.255950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:27.256900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:27.257443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:27.257608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:27.267616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:27.269302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d166-0723-4ff8-8453-0cc8663e5a5c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:27.288400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1051/2124] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:27.541431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:27.614065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd56b-71f2-461d-b19a-42072ae1bc90 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:27.618812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:27.619766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:27.619957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:27.620291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] PATH_INFO: `/v3/users/0c2c74c32db0435084b149d7926c8c81` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:27.621533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2c74c32db0435084b149d7926c8c81)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:27.623461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:27.658015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:27.680280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2c74c32db0435084b149d7926c8c81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:27.681298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2c74c32db0435084b149d7926c8c81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:27.688648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2c74c32db0435084b149d7926c8c81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:27.701284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2c74c32db0435084b149d7926c8c81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:27.709423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2c74c32db0435084b149d7926c8c81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:27.716457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1074/2125] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:27 2022] DELETE /identity/v3/users/0c2c74c32db0435084b149d7926c8c81 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:27.720942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:27.721236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:27.721519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:27.740722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:27.741948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:27.803348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1052/2126] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:27.813982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:27.815868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:27.873687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1e83-f4af-4554-b37b-d2d6d6c7c445 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:27.877355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:27.878004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:27.878286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:27.878560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:27.889135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:27.890647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bd14-d8f9-4bab-80b9-a43ce5dc9828 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:27.901712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1075/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:28.272838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:28.274356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:28.291244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed408-5f3d-4738-bfd4-67499548e265 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:28.296738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:28.297718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.298161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.298585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] PATH_INFO: `/v3/projects/125a038c446947eda44845b495bb6a4d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.300535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125a038c446947eda44845b495bb6a4d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:28.304341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:28.413246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:28.417595 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125a038c446947eda44845b495bb6a4d', 'request_id': 'req-a64e1e53-8b1f-44bd-982a-fa20ce12f877'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.426744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125a038c446947eda44845b495bb6a4d', 'request_id': 'req-a64e1e53-8b1f-44bd-982a-fa20ce12f877'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.437721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125a038c446947eda44845b495bb6a4d', 'request_id': 'req-a64e1e53-8b1f-44bd-982a-fa20ce12f877'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.454901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] The token cache is being invalidate because project 125a038c446947eda44845b495bb6a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:28.455374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.460807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.460807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1053/2128] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:28 2022] DELETE /identity/v3/projects/125a038c446947eda44845b495bb6a4d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:28.463732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707729d-4c49-4236-a10d-af1e395b1692 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.465211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707729d-4c49-4236-a10d-af1e395b1692 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.465211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707729d-4c49-4236-a10d-af1e395b1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.505153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a707729d-4c49-4236-a10d-af1e395b1692 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:28.505271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:28.506775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:28.508707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a707729d-4c49-4236-a10d-af1e395b1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:28.605528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1076/2129] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:28.613535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.614188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.614603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.660408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:28.663794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:28.705083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e1e53-8b1f-44bd-982a-fa20ce12f877 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:28.713894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1077/2130] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:28.719305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:28.726220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:28.727224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.727516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.727796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] PATH_INFO: `/v3/users/b76b74e1640640139dfb6be55fc7925b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.731740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76b74e1640640139dfb6be55fc7925b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:28.734342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:28.743162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07424fcb-c5c6-4be0-ae63-3969cedb7072 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:28.757812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:28.758689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.759127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.759781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.760767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:28.761784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:28.763685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:28.784868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1078/2131] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:28.789027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:28.803626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f53d3-1e75-46ad-85cd-93bee68b7861 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:28.812010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:28.812785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.813071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.813349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.814049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:28.816258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:28.864422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1079/2132] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:28 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:28.868535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:28.877663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76b74e1640640139dfb6be55fc7925b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.879413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:28.893705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76b74e1640640139dfb6be55fc7925b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.903980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76b74e1640640139dfb6be55fc7925b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.914069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76b74e1640640139dfb6be55fc7925b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.915102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-28b1084c-ac3d-4492-a188-097ef630a52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76b74e1640640139dfb6be55fc7925b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:28.925046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1054/2133] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:28 2022] DELETE /identity/v3/users/b76b74e1640640139dfb6be55fc7925b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:28.932569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:28.932864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:28.933151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:28.953727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:28.954990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:28.956901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113087-1e2d-47da-a5d2-de41673c2d05 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.008384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:29.019338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.020095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.020478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.030746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.030746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.030746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.031206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1055/2134] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:29.038583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.040083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.044650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1080/2135] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:28 2022] POST /identity/v3/users => generated 281 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:29.048471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.050101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.062584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ac-b530-472b-85c9-4e6842696afc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.067328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.068019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.068346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.068639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.069389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.071069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.084867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1081/2136] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:29.088784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.099660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65255d-7b46-45b4-a50c-9ab60d1839fc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.103480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c26e1-411d-4259-af26-f1c43bd67b26 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.105175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.105883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.106202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.106484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.107208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.107969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.108659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.108845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.108945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.109226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.118771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.119866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1082/2137] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:29.120371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895924d9-d55c-4809-8333-e1156f12bcf3 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.124500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.131068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1056/2138] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:29.134649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc2c4-165d-4647-8cc3-34646adb64f6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.139543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.140545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.140895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.141236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] PATH_INFO: `/v3/projects/3b7b7e9e4d8e49a1a2b967812ac661ab/users/0b640f6bea854e079acf11421a6dbe50/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.156434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7b7e9e4d8e49a1a2b967812ac661ab, user_id=0b640f6bea854e079acf11421a6dbe50, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.159169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.173588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1083/2139] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:29 2022] PUT /identity/v3/projects/3b7b7e9e4d8e49a1a2b967812ac661ab/users/0b640f6bea854e079acf11421a6dbe50/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:29.186067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.186777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.187302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.220857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] MFA Rules not processed for user `0b640f6bea854e079acf11421a6dbe50`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:29.222125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.338327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1057/2140] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:29.340022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.425104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:29.429870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d760-6bb0-46cd-81f2-bea2ad850a4a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.436839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.437772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.438272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.438647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.439450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.441623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.476230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1084/2141] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:29.479196 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.490324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570310f2-f62d-49ca-9ac3-dd0ecd65571e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.560140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.561013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.561307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.561589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.562298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.564262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.585184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1058/2142] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:29.589327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.600063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2e40-d6b5-4d7b-b452-92a26be6b388 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.605446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.606219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.606578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.606933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.607743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.609491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.623964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1085/2143] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:29.625223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.636999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e672e9-cd1b-442c-9d3f-5e111f3a0cea admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.642206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.643125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.643413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.643694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] PATH_INFO: `/v3/projects/e5286c158a1542d5871f41902a7361d8/users/c6305a05e10b483683927430df0d7a61/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.652558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.654516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.662413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:29.666275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5286c158a1542d5871f41902a7361d8, user_id=c6305a05e10b483683927430df0d7a61, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.670461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.680351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a783965-6fe0-4364-a73e-3e2a53a0aef9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.689213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1059/2144] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:29 2022] PUT /identity/v3/projects/e5286c158a1542d5871f41902a7361d8/users/c6305a05e10b483683927430df0d7a61/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:29.693328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.742134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.743039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.743325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.743611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] PATH_INFO: `/v3/projects/36ea2a28122045f9bc73bcd38d2e50e9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.744843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ea2a28122045f9bc73bcd38d2e50e9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.746846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.758790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385da57-4b8a-4046-9408-5c45bd8a39f7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.764044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.764741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.765277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.765277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.766027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.767696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.782762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1060/2145] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:29.783747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:29.793710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d295f-b2df-40fe-a10a-d75b2d7d8917 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:29.796661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ea2a28122045f9bc73bcd38d2e50e9', 'request_id': 'req-dd4f251b-a8c4-4200-afa7-90740df79ba8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:29.805329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ea2a28122045f9bc73bcd38d2e50e9', 'request_id': 'req-dd4f251b-a8c4-4200-afa7-90740df79ba8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:29.811006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ea2a28122045f9bc73bcd38d2e50e9', 'request_id': 'req-dd4f251b-a8c4-4200-afa7-90740df79ba8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:29.822337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] The token cache is being invalidate because project 36ea2a28122045f9bc73bcd38d2e50e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:29.822642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:29.823284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd4f251b-a8c4-4200-afa7-90740df79ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:29.825408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1086/2146] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:29 2022] DELETE /identity/v3/projects/36ea2a28122045f9bc73bcd38d2e50e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:29.830449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933346-e302-4412-8d8c-0205dba1cb90 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.830723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933346-e302-4412-8d8c-0205dba1cb90 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.831001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933346-e302-4412-8d8c-0205dba1cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.850555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2d933346-e302-4412-8d8c-0205dba1cb90 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:29.851790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d933346-e302-4412-8d8c-0205dba1cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.873256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:29.874159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.874446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.874727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] PATH_INFO: `/v3/projects/e5286c158a1542d5871f41902a7361d8/users/c6305a05e10b483683927430df0d7a61/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.876779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5286c158a1542d5871f41902a7361d8, user_id=c6305a05e10b483683927430df0d7a61, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:29.879490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4887c-d3f9-421d-ba01-e4f39b4b6445 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:29.890435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1061/2147] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:29 2022] PUT /identity/v3/projects/e5286c158a1542d5871f41902a7361d8/users/c6305a05e10b483683927430df0d7a61/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:29.900438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.900739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.901023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.923870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1087/2148] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:29.928981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] MFA Rules not processed for user `c6305a05e10b483683927430df0d7a61`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:29.930290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:29.931444 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:29.931784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:29.932016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:29.943070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:29.962898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:29.964186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.011558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1062/2149] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:30.022613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.024064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.032709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:30.036290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1088/2150] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:30.040297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.049375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505672-60d8-438c-8ffa-30d498250f9c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.054085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.054831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.055183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.055530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.056362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:30.056745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.058951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.074815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1089/2151] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:30.076209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.087320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb8f-517a-46a8-89ef-65225289c331 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.090395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0e34-0aa6-47b3-9686-af9141d51f63 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.093062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.093821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.094125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.094430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.095015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.095136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.095674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.095963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.096438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.097229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.109269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.110341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.121345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1063/2152] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:30.133439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1090/2153] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:30.137832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.148734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dabe5-eebc-48f8-b977-e2969a048341 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.210274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.210944 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.211229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.211512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.212274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.214739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.237166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1064/2154] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:30.241098 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.253351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2a5df-9358-495c-b845-4e76715a3bf4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.258017 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.258686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.258978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.259258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.259989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.263016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.276808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1091/2155] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:30.278257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.289449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d657b-8615-49f1-9217-29683d3eacb0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.294502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.295179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.295467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.296220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.296525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.308477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8aa4c7-de7f-400f-ade3-35fd5a5c22b0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.309978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1065/2156] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:30.315676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.327235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85551ca-ae68-4d3f-aa50-de53117a7054 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.332722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.333648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.334002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.334342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] PATH_INFO: `/v3/projects/f76b224a216b40449bc3fb1352fd6311/users/886ead7c4b1649d4bcd79ffe872fa304/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.356534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76b224a216b40449bc3fb1352fd6311, user_id=886ead7c4b1649d4bcd79ffe872fa304, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.360180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.374101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1092/2157] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:30 2022] PUT /identity/v3/projects/f76b224a216b40449bc3fb1352fd6311/users/886ead7c4b1649d4bcd79ffe872fa304/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:30.385276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.385713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.386445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.416461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] MFA Rules not processed for user `886ead7c4b1649d4bcd79ffe872fa304`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:30.418052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.491128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1066/2158] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:30.496053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.575710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e52ba-44da-4399-a95f-d93ac148c1ee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.581551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.594264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.594609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.594911 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.595378 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.595671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.596979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.599634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.618558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1826e-1d7f-4713-95c4-94e10a1feeef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.624538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.625578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.626055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.626549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] PATH_INFO: `/v3/users/0b640f6bea854e079acf11421a6dbe50` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.627969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b640f6bea854e079acf11421a6dbe50)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.634025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.638409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1093/2159] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:30.642307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.662101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:30.688843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:30.719165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b640f6bea854e079acf11421a6dbe50'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:30.732930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b640f6bea854e079acf11421a6dbe50'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:30.736748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f66f2-63a0-4455-a622-af488d9a0aa4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.740437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b640f6bea854e079acf11421a6dbe50'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:30.741480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.742148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.742436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.742720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.743449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.745932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.748665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b640f6bea854e079acf11421a6dbe50'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:30.749328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-38f586be-36d0-4e7d-b1ab-578aae8bc602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b640f6bea854e079acf11421a6dbe50'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:30.756558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1067/2160] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:30 2022] DELETE /identity/v3/users/0b640f6bea854e079acf11421a6dbe50 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:30.761635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.761884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.762216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.769010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1094/2161] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:30.773645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.775377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.782965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:30.784137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.787562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a05ba-7b42-45b7-a3c6-2d7e076c41fc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.843805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1068/2162] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:30.846047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.846742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.847031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.847310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.848081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.849778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.853749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.855226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:30.860025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1095/2163] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:30.863820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.877297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0573f-fe99-4284-83c5-99865b825826 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.883147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.883831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.884118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.884441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.885211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.887393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.900294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1096/2164] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:30.903590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:30.913797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3eea2-6a6e-4c44-b415-7ea2705d6374 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.918479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.919364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.919651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.919933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] PATH_INFO: `/v3/projects/3f334ff0325942fc9ebd4b8365a44f75/users/d904d5407451487a92f1efe1e0b79735/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.926095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9504-8626-4128-99c8-a8ac4176c3ca None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:30.929930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:30.930613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.930867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.931136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.935792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f334ff0325942fc9ebd4b8365a44f75, user_id=d904d5407451487a92f1efe1e0b79735, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.938544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc506c38-019e-4092-b03c-c419ef27d53f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.941553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:30.943039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:30.952461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1097/2165] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:30 2022] PUT /identity/v3/projects/3f334ff0325942fc9ebd4b8365a44f75/users/d904d5407451487a92f1efe1e0b79735/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:30.953924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1069/2166] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:30.963713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:30.964004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:30.964317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:30.990704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] MFA Rules not processed for user `d904d5407451487a92f1efe1e0b79735`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:30.992155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.066448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.073062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1098/2167] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:31.077799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.088538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f926971-f6c6-488c-965f-98a93e5b91fb service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.135192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.166932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.167708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.168071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.168450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.169226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.171261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.199606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1070/2168] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:31 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:31.203653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.214579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99db69-d927-4283-9620-1d67fe02e1ce None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.275053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.275764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.276052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.276392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.277089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.279010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.300232 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1099/2169] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:31 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:31.304696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.318565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3aa41-9e19-4f72-81ad-8c6983cf3c36 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.322383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.324505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.324912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.325949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.326242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.326528 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.327270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.329363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.338399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431349ff-a3bf-4679-8b9a-0cbf70120163 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.341407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1071/2170] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:31.345553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.347069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.348028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.348468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.348910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] PATH_INFO: `/v3/projects/3b7b7e9e4d8e49a1a2b967812ac661ab` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.350175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7b7e9e4d8e49a1a2b967812ac661ab)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.352209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.356429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c47b9-1bb8-4872-8b91-c5e04ece2232 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.362618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.363502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.363785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.364099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] PATH_INFO: `/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2/users/741a9cc4a9e642f3a8ebaf6fa7353185/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.382319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46abff8888e4e73bd3f9341cab3a1c2, user_id=741a9cc4a9e642f3a8ebaf6fa7353185, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.385138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.403642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1072/2171] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:31 2022] PUT /identity/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2/users/741a9cc4a9e642f3a8ebaf6fa7353185/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:31.408012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.411534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7b7e9e4d8e49a1a2b967812ac661ab', 'request_id': 'req-38535103-e1e8-4c75-88e2-7258097718de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.425109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7b7e9e4d8e49a1a2b967812ac661ab', 'request_id': 'req-38535103-e1e8-4c75-88e2-7258097718de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.434187 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7b7e9e4d8e49a1a2b967812ac661ab', 'request_id': 'req-38535103-e1e8-4c75-88e2-7258097718de'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.446281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] The token cache is being invalidate because project 3b7b7e9e4d8e49a1a2b967812ac661ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:31.446574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.447244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.448834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1100/2172] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:31 2022] DELETE /identity/v3/projects/3b7b7e9e4d8e49a1a2b967812ac661ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:31.452793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.455110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.484224 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77962b-48bd-4b66-b92c-1f92a2f977d3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.489022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.489693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.489983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.490292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.491024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.492689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.502773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1073/2173] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:31.506953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.508993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.518762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38535103-e1e8-4c75-88e2-7258097718de admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.521397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c660c1e-9c46-46c4-8a82-d4ce5fb1e982 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.523394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.524297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.524586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.524871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] PATH_INFO: `/v3/users/c6305a05e10b483683927430df0d7a61` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.526052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.526173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6305a05e10b483683927430df0d7a61)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.527466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.527747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.528022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] PATH_INFO: `/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2/users/741a9cc4a9e642f3a8ebaf6fa7353185/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.528574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.530203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46abff8888e4e73bd3f9341cab3a1c2, user_id=741a9cc4a9e642f3a8ebaf6fa7353185, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.532853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bc936-621b-43d0-96d4-25a299a4dac8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.544735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1074/2174] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:31 2022] PUT /identity/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2/users/741a9cc4a9e642f3a8ebaf6fa7353185/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:31.547556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.555709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.556002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.556318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.584939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] MFA Rules not processed for user `741a9cc4a9e642f3a8ebaf6fa7353185`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:31.586153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.586605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6305a05e10b483683927430df0d7a61'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.587282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6305a05e10b483683927430df0d7a61'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.596022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6305a05e10b483683927430df0d7a61'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.607855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6305a05e10b483683927430df0d7a61'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.615490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6305a05e10b483683927430df0d7a61'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:31.622185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1101/2175] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:31 2022] DELETE /identity/v3/users/c6305a05e10b483683927430df0d7a61 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:31.644095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:31.672405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1075/2176] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:31.680900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:31.684341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.773111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236118-8346-4c26-9399-1f4078c2cb83 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:31.779731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:31.780438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:31.780731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:31.781014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:31.783749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:31.865595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:31.867982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8913f-56b6-460e-b60a-2fabbb0ec8e1 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:31.901965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1102/2177] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:32.052357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.054064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:32.139063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b1b75-2710-4f35-90a6-b6e90d580d1e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.201749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.203081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.203425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.203735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] PATH_INFO: `/v3/projects/e5286c158a1542d5871f41902a7361d8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.205212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5286c158a1542d5871f41902a7361d8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.208839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.273825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5286c158a1542d5871f41902a7361d8', 'request_id': 'req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:32.281117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5286c158a1542d5871f41902a7361d8', 'request_id': 'req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:32.289998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5286c158a1542d5871f41902a7361d8', 'request_id': 'req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:32.302931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] The token cache is being invalidate because project e5286c158a1542d5871f41902a7361d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:32.303237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:32.303903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdb7a71e-9abd-4d77-98cb-3d92c39f021a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:32.305756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1076/2178] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:32 2022] DELETE /identity/v3/projects/e5286c158a1542d5871f41902a7361d8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:32.310699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.311026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.311306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.330102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:32.331409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:32.377542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:32.407252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1103/2179] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:32.409298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.409756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.410089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.447202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:32.449112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:32.465931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1077/2180] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:32.467353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.478851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009c366-1109-4281-ad03-edc42ec65a93 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.485451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.486246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.487316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.487869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.488749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:32.489165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.490954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.512885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1104/2181] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:32.517449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.527321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e31a3-65aa-4b58-883d-dcfecf941f16 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.532436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.533109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.533393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.533672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.534370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.536940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.560125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:32.571904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1078/2182] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:32.573080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.584577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477959-b884-473c-8747-a8f9f45a1c6b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.670756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.671743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.672034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.672343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.673062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.674992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.694941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1105/2183] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:32.699669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.710196 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095b9c-3774-4eb7-90a8-94ea03813115 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.715175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.715865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.716149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.716453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.717186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.718923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.729831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1079/2184] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:32.733858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.744978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88c86-324a-4abe-8f43-6106d3cda029 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.750263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.750947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.751251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.751564 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.752333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.754053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7d717-f80e-4447-87de-c8aa7eb5bedb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.769960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:32.770330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1106/2185] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:32.781163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862669cb-63c1-4c29-9f2b-b3dc7f19928d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:32.786577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:32.787611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.787857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.788218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] PATH_INFO: `/v3/projects/e0c608e60a384eea95bf354f3ca461d9/users/ddf1b9ba3b9a4a79959c323022484c9f/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.811629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c608e60a384eea95bf354f3ca461d9, user_id=ddf1b9ba3b9a4a79959c323022484c9f, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:32.821941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:32.838482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1080/2186] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:32 2022] PUT /identity/v3/projects/e0c608e60a384eea95bf354f3ca461d9/users/ddf1b9ba3b9a4a79959c323022484c9f/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:32.851028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:32.851669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:32.851768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:32.880589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] MFA Rules not processed for user `ddf1b9ba3b9a4a79959c323022484c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:32.881797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:32.954264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1107/2187] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:32.958760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.038877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c0ff-8d15-48af-b9ee-e33c2816d78e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.051390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.052313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.052878 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.053317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.054415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.061169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.110129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1081/2188] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:32 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:33.111033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.128467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016501-5504-4c48-9cd3-4e85b6a6edc0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.179548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:33.210367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.211045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.211532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.211844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.212726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.215032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.255627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1108/2189] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:33 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:33.259231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.272861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56eeb3-ca73-45de-89c4-6a1ec694074e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.283804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.285174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.285623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.286035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.286959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.288993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.312848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1082/2190] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:33.318279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.340574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d7bb0-450e-4930-9e59-8ba6061b6519 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.345831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.346977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.347367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.347747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] PATH_INFO: `/v3/projects/7282836383084368bc56d2110894aba5/users/f4ffbe3168cb4448adcbe92933cfb696/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.379839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282836383084368bc56d2110894aba5, user_id=f4ffbe3168cb4448adcbe92933cfb696, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.381347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.402794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1109/2191] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:33 2022] PUT /identity/v3/projects/7282836383084368bc56d2110894aba5/users/f4ffbe3168cb4448adcbe92933cfb696/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:33.403990 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.418394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835ced-b3e8-48cc-8a05-b5ed090267c6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.497481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.498439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.499302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.499643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:33.499742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.500062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.500895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.502604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.516380 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1083/2192] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:33.521971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.535387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1336-f213-45e6-adf4-d6b019e30678 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.540677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.541572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.541882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.542448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] PATH_INFO: `/v3/projects/7282836383084368bc56d2110894aba5/users/f4ffbe3168cb4448adcbe92933cfb696/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.544954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7282836383084368bc56d2110894aba5, user_id=f4ffbe3168cb4448adcbe92933cfb696, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.547934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae0410-791b-4bbf-bab7-a07aca4517ed admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.566449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1084/2193] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:33 2022] PUT /identity/v3/projects/7282836383084368bc56d2110894aba5/users/f4ffbe3168cb4448adcbe92933cfb696/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:33.575796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7035f6-d45c-4be3-98a4-57fe8f509770 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.576635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.576935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.577222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.605239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] MFA Rules not processed for user `f4ffbe3168cb4448adcbe92933cfb696`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:33.606495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:33.614673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:33.626172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.627139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.627139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.627377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.629201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:33.682030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1085/2194] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:33.692488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.693951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:33.706459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.707929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.711627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1a887-1c19-4116-8222-a682b1e9204f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.716527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.717191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.717535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.717907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.721271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1110/2195] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:33.728161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.730221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.739939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1086/2196] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:33.838520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:33.847386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5b547-a019-4683-adb2-0103ff109905 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:33.851304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:33.851954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:33.852288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:33.852615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:33.866129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:33.917482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:33.919696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:33.931567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1111/2197] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:34.329836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:34.340103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0bbea-f980-44b6-a749-1d7359f9efad service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:34.348729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:34.349753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:34.350218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:34.351244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:34.353718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:34.427521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:34.429056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab967b-73b6-455a-a5da-4fd9f7883890 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:34.439840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1087/2198] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:36.599578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:36.676477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377983f7-0f37-433c-bdeb-201475801d6a service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:36.683635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:36.684941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:36.686309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:36.686600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] PATH_INFO: `/v3/users/ddf1b9ba3b9a4a79959c323022484c9f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:36.687888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf1b9ba3b9a4a79959c323022484c9f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:36.689893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:36.751294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf1b9ba3b9a4a79959c323022484c9f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:36.752047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf1b9ba3b9a4a79959c323022484c9f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:36.762389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf1b9ba3b9a4a79959c323022484c9f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:36.783980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf1b9ba3b9a4a79959c323022484c9f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:36.793557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf1b9ba3b9a4a79959c323022484c9f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:36.801375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1112/2199] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:36 2022] DELETE /identity/v3/users/ddf1b9ba3b9a4a79959c323022484c9f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:36.805714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:36.806209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:36.806392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:36.829754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:36.831286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:36.898164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1088/2200] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:36.907680 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:36.909153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:36.945570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:36.969641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863f7b-8815-4f22-bd01-c30dedae523c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:36.973758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:36.974609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:36.974904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:36.975314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:36.986817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:36.988333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:36.999413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1113/2201] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:37.319956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:37.321477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:37.349513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb1bd-d7e3-41e4-a84d-63ba9f3d0e35 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:37.355368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:37.356290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:37.356598 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:37.356902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] PATH_INFO: `/v3/projects/e0c608e60a384eea95bf354f3ca461d9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:37.358136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c608e60a384eea95bf354f3ca461d9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:37.360440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:37.386149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:37.414020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c608e60a384eea95bf354f3ca461d9', 'request_id': 'req-bfe2678f-e159-4c16-9d50-e47d244cd922'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.420943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c608e60a384eea95bf354f3ca461d9', 'request_id': 'req-bfe2678f-e159-4c16-9d50-e47d244cd922'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.429070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c608e60a384eea95bf354f3ca461d9', 'request_id': 'req-bfe2678f-e159-4c16-9d50-e47d244cd922'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.440407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] The token cache is being invalidate because project e0c608e60a384eea95bf354f3ca461d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:37.440734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.441373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.442905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1089/2202] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:37 2022] DELETE /identity/v3/projects/e0c608e60a384eea95bf354f3ca461d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:37.446905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:37.456969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d1cc-a7c8-4b68-89b7-fbfcd835ebeb service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:37.519331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:37.520256 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:37.520548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:37.520830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] PATH_INFO: `/v3/users/f4ffbe3168cb4448adcbe92933cfb696` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:37.522036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ffbe3168cb4448adcbe92933cfb696)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:37.524041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:37.572307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ffbe3168cb4448adcbe92933cfb696'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.573494 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ffbe3168cb4448adcbe92933cfb696'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.580807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ffbe3168cb4448adcbe92933cfb696'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.593780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ffbe3168cb4448adcbe92933cfb696'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.608841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4ecd1008-7ca4-4fa6-8518-a47ff1bc887d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ffbe3168cb4448adcbe92933cfb696'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:37.615276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1114/2203] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:37 2022] DELETE /identity/v3/users/f4ffbe3168cb4448adcbe92933cfb696 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:37.931612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:37.933338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:37.961335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2678f-e159-4c16-9d50-e47d244cd922 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.039357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.040318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.040611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.040923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] PATH_INFO: `/v3/projects/7282836383084368bc56d2110894aba5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.042326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7282836383084368bc56d2110894aba5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.044957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.097279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7282836383084368bc56d2110894aba5', 'request_id': 'req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.103190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7282836383084368bc56d2110894aba5', 'request_id': 'req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.110615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7282836383084368bc56d2110894aba5', 'request_id': 'req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.123345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] The token cache is being invalidate because project 7282836383084368bc56d2110894aba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:38.123647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.124375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53e6252f-9d02-45c6-bf9a-de2366cdc6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.126341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1090/2204] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:37 2022] DELETE /identity/v3/projects/7282836383084368bc56d2110894aba5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:38.131155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.131552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.131918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.153247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:38.154569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.212923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:38.224985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1115/2205] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:38.234099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.234398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.234701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.255098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:38.256538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.265321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1091/2206] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:38.269711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.280518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bda7-4496-49ff-b382-84c71105f20b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.285329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.286013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.286297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.286572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.287326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:38.287633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.289289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.301480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1116/2207] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:38.306660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.317374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9245fd-452f-4820-9efd-19af31dae679 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.322624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.323985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.324299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.324581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.325486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.328613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.361063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1092/2208] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:38.365980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.378303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8664-795e-4f58-a73a-04363fc2cf15 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.469904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.470588 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.471016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.471161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.474947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.474947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.500939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1117/2209] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:38.501384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.501920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.503093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.517016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1146f-87d9-41db-bdf2-936c2c2b2c99 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.520542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566b86-9913-46da-aa96-a44a3d4d4f6e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.523210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.523883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.524178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.524487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.525225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.526920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.533204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.534186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.534541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.534888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] PATH_INFO: `/v3/users/886ead7c4b1649d4bcd79ffe872fa304` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.536430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=886ead7c4b1649d4bcd79ffe872fa304)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.538435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.544247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1118/2210] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:38.545223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:38.546765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.568537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8273-b321-4682-a401-61b34c0096f9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.575996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.576864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.577200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.577584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.578669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.580447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.600340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1119/2211] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:38.605792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.623909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e9d16-1a2f-442d-83b8-53d3e478760d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.638456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.639768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.639913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.640341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] PATH_INFO: `/v3/projects/3ec42b7b8fc440eb8e8abd1b28b017b1/users/06f051ba9698473d8ce67b8ccff06be5/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.664321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886ead7c4b1649d4bcd79ffe872fa304'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.684160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec42b7b8fc440eb8e8abd1b28b017b1, user_id=06f051ba9698473d8ce67b8ccff06be5, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.684332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886ead7c4b1649d4bcd79ffe872fa304'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.688066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1af1a-7df7-4514-929b-52471ed6e9a6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.695009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886ead7c4b1649d4bcd79ffe872fa304'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.703056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886ead7c4b1649d4bcd79ffe872fa304'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.704173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ec82864d-c441-44c6-974e-2eac8a327bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886ead7c4b1649d4bcd79ffe872fa304'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:38.706436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1120/2212] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:38 2022] PUT /identity/v3/projects/3ec42b7b8fc440eb8e8abd1b28b017b1/users/06f051ba9698473d8ce67b8ccff06be5/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:38.712964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1093/2213] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:38 2022] DELETE /identity/v3/users/886ead7c4b1649d4bcd79ffe872fa304 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:38.718591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.718927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.719240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.721740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.722036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.722470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.737979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:38.739207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.752257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] MFA Rules not processed for user `06f051ba9698473d8ce67b8ccff06be5`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:38.753478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.802772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1121/2214] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:38.813234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.814893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.822868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1094/2215] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:38.824497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.825843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:38.841313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284b278-f935-415f-83c2-87bdc737b264 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.846264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.846910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.847286 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.847570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.848296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.850250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.856646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:38.884753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c821-4360-4550-872e-21bcf95f3604 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.889036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.889700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.889990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.890285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.890887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1095/2216] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:38.894823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:38.902698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.904178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:38.915297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1122/2217] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:38.954733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:38.968405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6c01-eb0f-412a-a39c-deb818be8a0c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:38.980041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:38.980815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:38.981104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:38.981387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:38.982099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:38.984629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.009939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1096/2218] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:38 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:39.011292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.022198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcf51-d3fa-45e7-adad-e003bac3bc9b service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.029266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.030301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.030750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.031169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.032361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.035082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.056503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1123/2219] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:39.058727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.092930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c389bff-28e9-4f3b-8af4-81100c501856 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.100372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.101526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.102086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.102386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] PATH_INFO: `/v3/projects/5ae8657698664eb8a588971659f1991d/users/c756209f3e244f21975802e13b7661ba/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.123796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae8657698664eb8a588971659f1991d, user_id=c756209f3e244f21975802e13b7661ba, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.128363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.148325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1097/2220] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:39 2022] PUT /identity/v3/projects/5ae8657698664eb8a588971659f1991d/users/c756209f3e244f21975802e13b7661ba/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:39.153409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.172922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037b17-a7fb-4fe0-b540-b7c71371e6f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.231441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.240871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.246239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.247354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.247742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.248278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.249172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.250855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.267683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1124/2221] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:39.269057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.271406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead17ec-12e5-454b-ba74-5c84b63b3c3d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.276270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.277146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.277434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.277714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] PATH_INFO: `/v3/projects/f76b224a216b40449bc3fb1352fd6311` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.278919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76b224a216b40449bc3fb1352fd6311)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.279663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc65f-14eb-4332-b081-0f094a91a4f3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.280882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.284452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.285407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.285756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.286122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] PATH_INFO: `/v3/projects/5ae8657698664eb8a588971659f1991d/users/c756209f3e244f21975802e13b7661ba/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.288160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae8657698664eb8a588971659f1991d, user_id=c756209f3e244f21975802e13b7661ba, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.290893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9d4fd-bc05-4e64-8405-9ffa5ecc3c82 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.303339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1125/2222] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:39 2022] PUT /identity/v3/projects/5ae8657698664eb8a588971659f1991d/users/c756209f3e244f21975802e13b7661ba/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:39.315837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.316686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.316686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.332442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76b224a216b40449bc3fb1352fd6311', 'request_id': 'req-d3c6f345-384b-407b-aac3-e337a22facf7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.338276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76b224a216b40449bc3fb1352fd6311', 'request_id': 'req-d3c6f345-384b-407b-aac3-e337a22facf7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.343167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] MFA Rules not processed for user `c756209f3e244f21975802e13b7661ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:39.344719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.349052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76b224a216b40449bc3fb1352fd6311', 'request_id': 'req-d3c6f345-384b-407b-aac3-e337a22facf7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.363429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] The token cache is being invalidate because project f76b224a216b40449bc3fb1352fd6311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:39.363994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.364851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.367114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1098/2223] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:39 2022] DELETE /identity/v3/projects/f76b224a216b40449bc3fb1352fd6311 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:39.371506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.373083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.429295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1126/2224] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:39.444712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.446664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.447609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f345-384b-407b-aac3-e337a22facf7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.453071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.453952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.454243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.454518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] PATH_INFO: `/v3/users/d904d5407451487a92f1efe1e0b79735` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.455732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d904d5407451487a92f1efe1e0b79735)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.457741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.482002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:39.519086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:39.525389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd904d5407451487a92f1efe1e0b79735'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.527003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192150b0-8795-4add-a7dc-8122f728a9de None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.531141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.531791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.532076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.532387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.540077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd904d5407451487a92f1efe1e0b79735'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.541689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.543485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588cc40-7842-4138-9ddc-6605b8b255e9 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.547991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd904d5407451487a92f1efe1e0b79735'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.553355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1127/2225] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:39.555926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd904d5407451487a92f1efe1e0b79735'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.556489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d497c9-3597-4626-827a-ca68a19590f5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.556698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd904d5407451487a92f1efe1e0b79735'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.556816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d497c9-3597-4626-827a-ca68a19590f5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.557047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d497c9-3597-4626-827a-ca68a19590f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.565129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1099/2226] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:39 2022] DELETE /identity/v3/users/d904d5407451487a92f1efe1e0b79735 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:39.576710 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-29d497c9-3597-4626-827a-ca68a19590f5 None None] MFA Rules not processed for user `0e3dacd75e3a47d9bda05d873826c818`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:39.578251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-29d497c9-3597-4626-827a-ca68a19590f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.664039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1128/2227] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:39.712782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.714955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.798943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a381f5-1db5-41a8-8839-7756f2c6b9b3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:39.803698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:39.804610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.804909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.805170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] PATH_INFO: `/v3/users/06f051ba9698473d8ce67b8ccff06be5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.806372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f051ba9698473d8ce67b8ccff06be5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:39.808504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:39.856989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f051ba9698473d8ce67b8ccff06be5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.869718 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f051ba9698473d8ce67b8ccff06be5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.878520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f051ba9698473d8ce67b8ccff06be5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.891611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f051ba9698473d8ce67b8ccff06be5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.892599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f051ba9698473d8ce67b8ccff06be5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:39.901029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1100/2228] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:39 2022] DELETE /identity/v3/users/06f051ba9698473d8ce67b8ccff06be5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:39.906699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:39.906998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:39.907285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:39.913867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:39.917016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.934342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:39.935495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:39.965110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:39.998426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0b65d-a06d-48f4-b956-1ab26c39e760 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.005551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.006477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.006789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.007094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] PATH_INFO: `/v3/projects/3f334ff0325942fc9ebd4b8365a44f75` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.008350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f334ff0325942fc9ebd4b8365a44f75)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.010097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1129/2229] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:40.011779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.021623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:40.023274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.068721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f334ff0325942fc9ebd4b8365a44f75', 'request_id': 'req-30c15f7e-8d30-4548-979d-df7caa0a7f56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.074109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f334ff0325942fc9ebd4b8365a44f75', 'request_id': 'req-30c15f7e-8d30-4548-979d-df7caa0a7f56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.082341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f334ff0325942fc9ebd4b8365a44f75', 'request_id': 'req-30c15f7e-8d30-4548-979d-df7caa0a7f56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.085705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95472b8-93fc-4576-bb2b-8b4e869ab525 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.093369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] The token cache is being invalidate because project 3f334ff0325942fc9ebd4b8365a44f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:40.093654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.094303 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.095890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1101/2230] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:39 2022] DELETE /identity/v3/projects/3f334ff0325942fc9ebd4b8365a44f75 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:40.099861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:40.101324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.117513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:40.140643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.141296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.141581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.141868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.143744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.168046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15f7e-8d30-4548-979d-df7caa0a7f56 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.173025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.173922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.174213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.174493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] PATH_INFO: `/v3/users/741a9cc4a9e642f3a8ebaf6fa7353185` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.175698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741a9cc4a9e642f3a8ebaf6fa7353185)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.177691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.222089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.223451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.240774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1130/2231] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:40.255547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741a9cc4a9e642f3a8ebaf6fa7353185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.269668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741a9cc4a9e642f3a8ebaf6fa7353185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.278733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:40.286789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741a9cc4a9e642f3a8ebaf6fa7353185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.296911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741a9cc4a9e642f3a8ebaf6fa7353185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.297778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741a9cc4a9e642f3a8ebaf6fa7353185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.306943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1102/2232] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:40 2022] DELETE /identity/v3/users/741a9cc4a9e642f3a8ebaf6fa7353185 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:40.532267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:40.533908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.550648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00c045-92c9-470c-8ed5-a74e51630421 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.621463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.622029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.622329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.622615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] PATH_INFO: `/v3/projects/3ec42b7b8fc440eb8e8abd1b28b017b1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.623914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec42b7b8fc440eb8e8abd1b28b017b1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.626087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.688913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec42b7b8fc440eb8e8abd1b28b017b1', 'request_id': 'req-ad0dffd1-2f96-4495-bdf4-4e619cc89578'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.696515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec42b7b8fc440eb8e8abd1b28b017b1', 'request_id': 'req-ad0dffd1-2f96-4495-bdf4-4e619cc89578'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.703789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec42b7b8fc440eb8e8abd1b28b017b1', 'request_id': 'req-ad0dffd1-2f96-4495-bdf4-4e619cc89578'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.713565 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:40.715661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.716515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] The token cache is being invalidate because project 3ec42b7b8fc440eb8e8abd1b28b017b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:40.716806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.717482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.719242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1131/2233] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:40 2022] DELETE /identity/v3/projects/3ec42b7b8fc440eb8e8abd1b28b017b1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:40.725263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:40.726622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:40.737263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536ae3-9e97-46dc-9ae3-681ebdd21d95 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.742037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:40.803351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dffd1-2f96-4495-bdf4-4e619cc89578 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:40.806691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.807591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.807880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.808014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:40.808167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] PATH_INFO: `/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.808952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.809243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.809394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46abff8888e4e73bd3f9341cab3a1c2)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.809523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] PATH_INFO: `/v3/users/c756209f3e244f21975802e13b7661ba` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.810718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c756209f3e244f21975802e13b7661ba)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:40.811318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.812774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:40.864794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c756209f3e244f21975802e13b7661ba'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.865008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46abff8888e4e73bd3f9341cab3a1c2', 'request_id': 'req-a85cb089-41ff-4428-a951-b9a9b5d4803e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.865484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c756209f3e244f21975802e13b7661ba'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.871616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46abff8888e4e73bd3f9341cab3a1c2', 'request_id': 'req-a85cb089-41ff-4428-a951-b9a9b5d4803e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.873455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c756209f3e244f21975802e13b7661ba'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.878682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46abff8888e4e73bd3f9341cab3a1c2', 'request_id': 'req-a85cb089-41ff-4428-a951-b9a9b5d4803e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.886638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c756209f3e244f21975802e13b7661ba'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.890968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] The token cache is being invalidate because project d46abff8888e4e73bd3f9341cab3a1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:40.891240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.891936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a85cb089-41ff-4428-a951-b9a9b5d4803e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.893744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1103/2234] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:40 2022] DELETE /identity/v3/projects/d46abff8888e4e73bd3f9341cab3a1c2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:40.897810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-648a4bbf-8178-40f9-9ff0-7d2790348ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c756209f3e244f21975802e13b7661ba'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:40.898638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:40.898996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:40.899388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:40.905149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1132/2235] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:40 2022] DELETE /identity/v3/users/c756209f3e244f21975802e13b7661ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:40.920480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:40.921715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.002500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1104/2236] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:41.010221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.010660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.011059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.029910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:41.031136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.039387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1133/2237] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:41.044522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.054307 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3372ed-4047-42c9-bd87-7c114f72ef40 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.059309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.059998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.060323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.060606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.061354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:41.065165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.065165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.078140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1105/2238] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:41.082648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.093120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc5863-677c-43f3-89fb-d3620cb70a55 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.097899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.098550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.098834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.099113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.099817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.101784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.133630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1134/2239] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:41.134804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.142532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:41.147302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da1eea-0eef-420f-a522-5840e8165750 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.229320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.229930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.230683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.231052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.231177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.231452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.232329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.234311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.251230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e569-8d1d-4255-8166-ecdd4858f5d7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.256338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.257357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.257809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.258154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] PATH_INFO: `/v3/projects/5ae8657698664eb8a588971659f1991d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.259050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1106/2240] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:41.259615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae8657698664eb8a588971659f1991d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.262426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.263034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.273069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee529-8688-4ee5-ba20-7d7eb7f99984 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.280591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.280591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.280591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.280591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.281600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.283477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.295441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1107/2241] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:41.300210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.310626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ea2d4-2339-4cc4-a9e9-834aa29d8e36 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.318503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae8657698664eb8a588971659f1991d', 'request_id': 'req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:41.329525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae8657698664eb8a588971659f1991d', 'request_id': 'req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:41.331236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:41.337638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae8657698664eb8a588971659f1991d', 'request_id': 'req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:41.350446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] The token cache is being invalidate because project 5ae8657698664eb8a588971659f1991d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:41.350760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:41.351422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-72cdf07d-c04b-489b-bbeb-1e2b2c7bea2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:41.353267 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1135/2242] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:41 2022] DELETE /identity/v3/projects/5ae8657698664eb8a588971659f1991d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:41.358549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ffd0-3d55-43ad-b84e-d0fc1c606b60 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.359007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ffd0-3d55-43ad-b84e-d0fc1c606b60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.359328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ffd0-3d55-43ad-b84e-d0fc1c606b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.370135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.370807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.371090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.371367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.372806 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.374655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.379183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4dd5ffd0-3d55-43ad-b84e-d0fc1c606b60 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:41.380470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4dd5ffd0-3d55-43ad-b84e-d0fc1c606b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.388368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1108/2243] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:41.391339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1136/2244] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:41.392921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.397577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.400496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.400791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.401176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.407503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806706b-8f35-4b4b-87a9-b506064752b0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.412808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.413839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.414197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.414575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] PATH_INFO: `/v3/projects/ce96512fcc7c47e8a3a572318630be2b/users/3283bab75b9b47a9924eb68fd8ae7bc1/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.420587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:41.421793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.437821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce96512fcc7c47e8a3a572318630be2b, user_id=3283bab75b9b47a9924eb68fd8ae7bc1, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.438368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1137/2245] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:48:41.440705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caadd51-fae9-4328-8dee-0b7e136b6db5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.442518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.452009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4780-8c92-49b1-aa4a-8a0eb60764ab None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.454722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1109/2246] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:41 2022] PUT /identity/v3/projects/ce96512fcc7c47e8a3a572318630be2b/users/3283bab75b9b47a9924eb68fd8ae7bc1/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:41.465816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669627c-3377-438f-adb0-eacebf27653c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.466191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669627c-3377-438f-adb0-eacebf27653c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.466496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669627c-3377-438f-adb0-eacebf27653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.492104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3669627c-3377-438f-adb0-eacebf27653c None None] MFA Rules not processed for user `3283bab75b9b47a9924eb68fd8ae7bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:41.493345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3669627c-3377-438f-adb0-eacebf27653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.511113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.511355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.511650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.511932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.512998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:41.513693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.515355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.528411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1138/2247] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 13:48:41.533021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.539914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:41.545060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941c40-f594-4d83-a322-d8431dd27f1b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.550353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.552420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.553058 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.553745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.555168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.557397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.564227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1110/2248] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:41.575204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669627c-3377-438f-adb0-eacebf27653c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.576648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3669627c-3377-438f-adb0-eacebf27653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.591367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1139/2249] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:41.595448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.644054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669627c-3377-438f-adb0-eacebf27653c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.671153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755335-4ede-47b5-9aa5-c597620f3ea8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.676115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.676826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.677421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.677421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.678065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.679999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.705744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1140/2250] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:41.711734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.720352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.721011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.721292 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.721580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.724216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affa9d-e060-4f1a-8fc2-75c25ac0c27d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.732417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.733109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.733401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.733685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.734431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.736283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.746961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1141/2251] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:41.750980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.761137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022818-8333-43ff-8745-02d52d1925e3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.765720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.766365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.766657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.766945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.767692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.769320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.780572 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1142/2252] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:48:41.784702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:41.786500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.787967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915d2f-b810-49b1-9c07-5a1b7b654ab4 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.794848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb68b-d620-4aa9-86e3-d1260e249e38 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:41.799486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:41.800392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.800678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.800955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] PATH_INFO: `/v3/projects/2c7d7e68345e467a891d91a665604a8a/users/f0758840370e4c8e8a8f940fefa4ef39/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.804325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1111/2253] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:41.810283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:41.820329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7d7e68345e467a891d91a665604a8a, user_id=f0758840370e4c8e8a8f940fefa4ef39, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:41.824308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:41.839864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1143/2254] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:41 2022] PUT /identity/v3/projects/2c7d7e68345e467a891d91a665604a8a/users/f0758840370e4c8e8a8f940fefa4ef39/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:48:41.851463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:41.852031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:41.852530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:41.881428 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] MFA Rules not processed for user `f0758840370e4c8e8a8f940fefa4ef39`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:41.882643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:41.928050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:41.963655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1112/2255] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:41.968402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.052316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec561e-dc5d-4289-a2aa-ceed64e839d3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.057821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.058483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.058763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.059038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.059743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.062323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.095919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1144/2256] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:41 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 13:48:42.098176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.113814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd6c5-bdbf-4578-87e3-7ebf891ecc43 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.177317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.178014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.178304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.178584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.179279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.181291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.200612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1113/2257] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:42 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:42.205068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.215850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e77ed-ecd4-49e0-9d9f-a86183efb5fb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.220495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.221155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.221450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.221732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.222459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.224069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.234997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1145/2258] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:42.238957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.249755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3f77-5f69-458f-b377-429a4342bf2e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.254653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.255536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.255822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.256102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] PATH_INFO: `/v3/projects/93955c1918aa4375855bb2d526ca88b9/users/e8a060a1aa184a4d96746502459b8f8c/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.270956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93955c1918aa4375855bb2d526ca88b9, user_id=e8a060a1aa184a4d96746502459b8f8c, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.273610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.287018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1114/2259] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:42 2022] PUT /identity/v3/projects/93955c1918aa4375855bb2d526ca88b9/users/e8a060a1aa184a4d96746502459b8f8c/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:42.290979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.301645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc284c-32a8-4321-9f82-8914a52ec3b9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.360752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.361436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.361727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.362043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.362797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.364490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aea07-eb07-435a-86ad-b4e7cd7f03be admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.375108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1146/2260] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:42.379249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.389530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc42b-04aa-48a7-88d0-36794d2dd4d4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.394171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.395163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.395462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.395741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] PATH_INFO: `/v3/projects/93955c1918aa4375855bb2d526ca88b9/users/e8a060a1aa184a4d96746502459b8f8c/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.397942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93955c1918aa4375855bb2d526ca88b9, user_id=e8a060a1aa184a4d96746502459b8f8c, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.400773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.413245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1115/2261] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:42 2022] PUT /identity/v3/projects/93955c1918aa4375855bb2d526ca88b9/users/e8a060a1aa184a4d96746502459b8f8c/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:42.425381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c8f2-e176-49f6-9f53-4920b56cef20 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.425681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c8f2-e176-49f6-9f53-4920b56cef20 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.425965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c8f2-e176-49f6-9f53-4920b56cef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.454466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-00d4c8f2-e176-49f6-9f53-4920b56cef20 None None] MFA Rules not processed for user `e8a060a1aa184a4d96746502459b8f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:42.455733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-00d4c8f2-e176-49f6-9f53-4920b56cef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:42.502457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:42.529138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1147/2262] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:42.540029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:42.595653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d208-4f59-458b-a0d8-d5a523da6533 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:42.599270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:42.599913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:42.600216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:42.600522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:42.652452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:42.662573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:42.664030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:42.672958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1116/2263] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:43.194887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23944026-0968-4d5b-868c-2b597def2492 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:43.195428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23944026-0968-4d5b-868c-2b597def2492 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:43.195428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23944026-0968-4d5b-868c-2b597def2492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:43.215372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-23944026-0968-4d5b-868c-2b597def2492 None None] MFA Rules not processed for user `3283bab75b9b47a9924eb68fd8ae7bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:43.216738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-23944026-0968-4d5b-868c-2b597def2492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:43.276178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1148/2264] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:47.000448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:47.009047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72a03-37f2-4036-a705-4a47dcba0de6 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:47.012908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:47.013484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:47.013771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:47.014100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:47.024994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:47.027100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7181af-d10a-4ac4-88c5-1dea4ef89042 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:47.037394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1117/2265] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:48:52.029928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23944026-0968-4d5b-868c-2b597def2492 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:52.093845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23944026-0968-4d5b-868c-2b597def2492 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:52.098634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:52.099502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:52.099787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:52.100064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] PATH_INFO: `/v3/users/f0758840370e4c8e8a8f940fefa4ef39` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:52.101587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0758840370e4c8e8a8f940fefa4ef39)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:52.103534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:52.148011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0758840370e4c8e8a8f940fefa4ef39'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.148685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0758840370e4c8e8a8f940fefa4ef39'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.156538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0758840370e4c8e8a8f940fefa4ef39'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.168306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0758840370e4c8e8a8f940fefa4ef39'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.176550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0758840370e4c8e8a8f940fefa4ef39'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.183064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1149/2266] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:52 2022] DELETE /identity/v3/users/f0758840370e4c8e8a8f940fefa4ef39 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:52.187616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:52.188112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:52.188223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:52.206042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:52.207240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:52.266640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1118/2267] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:52.277515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:52.278985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:52.289230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:52.342597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954b86-013c-4f34-919a-12538d2ba7b6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:52.346370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:52.347016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:52.347307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:52.347585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:52.358320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:52.359752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:52.371211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1150/2268] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:48:52.644446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:52.645872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:52.661121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad29b-f42b-453e-bee7-d6c5eabe26f6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:52.665839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:52.666743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:52.667051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:52.667330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] PATH_INFO: `/v3/projects/2c7d7e68345e467a891d91a665604a8a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:52.668750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7d7e68345e467a891d91a665604a8a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:52.670730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:52.727370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7d7e68345e467a891d91a665604a8a', 'request_id': 'req-80ecab1e-848f-4d0b-a936-18295b63aad1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.733624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7d7e68345e467a891d91a665604a8a', 'request_id': 'req-80ecab1e-848f-4d0b-a936-18295b63aad1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.741561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7d7e68345e467a891d91a665604a8a', 'request_id': 'req-80ecab1e-848f-4d0b-a936-18295b63aad1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.753433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] The token cache is being invalidate because project 2c7d7e68345e467a891d91a665604a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:52.753805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.754458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.756028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1119/2269] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:52 2022] DELETE /identity/v3/projects/2c7d7e68345e467a891d91a665604a8a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:52.760774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:52.770768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb8bc-e5f1-498c-afe4-a15e17e19ecc service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:52.833052 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:52.833942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:52.834236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:52.834513 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] PATH_INFO: `/v3/users/e8a060a1aa184a4d96746502459b8f8c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:52.836244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a060a1aa184a4d96746502459b8f8c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:52.838068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:52.897165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a060a1aa184a4d96746502459b8f8c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.897829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a060a1aa184a4d96746502459b8f8c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.906140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a060a1aa184a4d96746502459b8f8c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.922233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a060a1aa184a4d96746502459b8f8c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.930527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4f39fd49-c790-46fd-876d-98430a14f14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a060a1aa184a4d96746502459b8f8c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:52.940290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1151/2270] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:48:52 2022] DELETE /identity/v3/users/e8a060a1aa184a4d96746502459b8f8c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:53.228558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.230839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:53.244646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab1e-848f-4d0b-a936-18295b63aad1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.308805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.309691 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.309983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.310263 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] PATH_INFO: `/v3/projects/93955c1918aa4375855bb2d526ca88b9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.311542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93955c1918aa4375855bb2d526ca88b9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.318796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.318796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:53.368706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93955c1918aa4375855bb2d526ca88b9', 'request_id': 'req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:53.375115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93955c1918aa4375855bb2d526ca88b9', 'request_id': 'req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:53.383072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93955c1918aa4375855bb2d526ca88b9', 'request_id': 'req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:53.395618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] The token cache is being invalidate because project 93955c1918aa4375855bb2d526ca88b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:48:53.395904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:53.396566 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f7d20844-c5cf-4691-9b9d-bd551ccbcda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:48:53.398403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1120/2271] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:48:53 2022] DELETE /identity/v3/projects/93955c1918aa4375855bb2d526ca88b9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:53.404308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.404757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.404869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.441287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:53.442552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:53.483020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:48:53.520018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1152/2272] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:53.529171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.529465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.529748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.547581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:53.548814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:53.557584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1121/2273] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:53.561876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.573421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ec793-876e-428c-9ebe-92a160c8e6f9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.578280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.578937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.579229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.579514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.580275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:48:53.580591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.583099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.602778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1153/2274] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:48:53.607300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.616898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6f8b-b443-4f25-95f8-2b053724f933 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.622285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.623613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.623904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.624187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.624910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.626846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.661604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1122/2275] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:48:53 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:53.666502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.677199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd2c1-af7f-4be2-a368-1d7f917aaca2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.736756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.737452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.737736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.738024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.738885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.741268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.764850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1154/2276] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:48:53 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:48:53.768820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.780421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d3b93-a157-46ae-a678-14e12ad09c3f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.785050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.785711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.786003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.786282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.787015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.788678 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.799772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1123/2277] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:53.803998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.813996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70da4-8487-4896-8367-27a1ee202e6f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.818635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.819290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.819594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.819861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.820633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.822237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf54cf-96ed-4d9e-920d-695498153445 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.832391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1155/2278] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:48:53.836397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:53.846843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5d49-d855-4514-9c66-52bc0da1b7db admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:53.851500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:53.852403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.852692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.852974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] PATH_INFO: `/v3/projects/1b28b0ed13594df29da0f7508a7d7943/users/a25daa8c4d734a63b3624ff08e23cd46/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.871046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b28b0ed13594df29da0f7508a7d7943, user_id=a25daa8c4d734a63b3624ff08e23cd46, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:53.874209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:53.887257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1124/2279] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:48:53 2022] PUT /identity/v3/projects/1b28b0ed13594df29da0f7508a7d7943/users/a25daa8c4d734a63b3624ff08e23cd46/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:48:53.898584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:53.898912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:53.899161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:53.929170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] MFA Rules not processed for user `a25daa8c4d734a63b3624ff08e23cd46`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:48:53.930308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:54.005804 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1156/2280] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:48:54.015166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:48:54.016921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:48:54.078657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5368ed-516d-4fe5-9f98-ac4e1159b7d6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:48:54.082352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:48:54.083010 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:48:54.083300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:48:54.083588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:48:54.092802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:48:54.094270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6009f-341c-48cf-86c7-460e8b91537a service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:48:54.103171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1125/2281] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:48:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:03.997875 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:04.099050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:10.016153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:10.017643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:10.112672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c3f3-c498-4a77-89da-7f150e39e690 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:10.118381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:10.119535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:10.120033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:10.120633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] PATH_INFO: `/v3/users/33ffc8aa33444926afae18059a6af753` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:10.124467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ffc8aa33444926afae18059a6af753)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:10.124467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:10.213579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ffc8aa33444926afae18059a6af753'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:10.214190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ffc8aa33444926afae18059a6af753'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:10.222215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ffc8aa33444926afae18059a6af753'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:10.240076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ffc8aa33444926afae18059a6af753'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:10.250686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ffc8aa33444926afae18059a6af753'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:10.258292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1157/2282] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:10 2022] DELETE /identity/v3/users/33ffc8aa33444926afae18059a6af753 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:10.263334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:10.263893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:10.263893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:10.283740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:10.285014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:10.370716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1126/2283] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:10.383158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:10.387055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:10.487772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2820b3-eded-491c-a81c-7d5b4f26a55e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:10.492122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:10.492994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:10.493442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:10.494443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:10.506677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:10.508615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15f3fe-7878-4e8d-962c-c99acb6ea32d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:10.528428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1158/2284] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:11.169442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.171513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:11.187316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad3af-67c4-48c3-b70e-7e2c3267c776 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.199977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.200751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.201061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.201411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] PATH_INFO: `/v3/projects/c351b8ccf2ff4c73af26732ae16ac582` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.202501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c351b8ccf2ff4c73af26732ae16ac582)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.205083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.256394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c351b8ccf2ff4c73af26732ae16ac582', 'request_id': 'req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:11.262707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c351b8ccf2ff4c73af26732ae16ac582', 'request_id': 'req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:11.270422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c351b8ccf2ff4c73af26732ae16ac582', 'request_id': 'req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:11.282370 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] The token cache is being invalidate because project c351b8ccf2ff4c73af26732ae16ac582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:11.282661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:11.283294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8442d7a5-09c1-4e35-89ff-3eaa9d160d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:11.284921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1127/2285] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:11 2022] DELETE /identity/v3/projects/c351b8ccf2ff4c73af26732ae16ac582 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:11.290156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.291346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.291760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.311127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:11.312383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:11.332161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:11.379391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1159/2286] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:49:11.387869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.388164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.388488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.407305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:11.408660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:11.418225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1128/2287] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:11.422737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.433476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423b8e9-e153-46a6-8dc2-3fa885eb1b05 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.438072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.438722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.439013 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.439295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.440047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:49:11.440460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.442075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.454262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1160/2288] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:49:11.458354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.467761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec50af-5b3a-4f9e-85df-14bc76f8ab23 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.472537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.473260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.473551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.473831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.474535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.476464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.504322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1129/2289] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:49:11 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:11.508382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.518842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf026-46ff-4e12-b2ef-cb1893532446 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.582524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.583205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.583495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.583778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.584512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.586483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.607596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1161/2290] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:49:11 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:11.612994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.625578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ca2c4-482a-45a9-abde-76eca037e1d3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.630395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.631097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.631391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.631676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.632447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.634067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.645609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1130/2291] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:11.649652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.661129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0458330-be63-4099-b0dc-dc9dfc72c438 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.666091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.666732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.667419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.667419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.668145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.669775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048984-2e67-4ecc-a1a9-3adf849bada9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.680084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1162/2292] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:11.684847 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.695617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad23b9-6efa-4ce1-ba20-fa5efb781ac0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.702825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.703708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.703994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.704422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] PATH_INFO: `/v3/projects/a7ea8b0f962746ed89bc81d98f83f2f0/users/bab646f098bf4921bc4f42d0c5bb5319/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.721864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ea8b0f962746ed89bc81d98f83f2f0, user_id=bab646f098bf4921bc4f42d0c5bb5319, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.724581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:11.737974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1131/2293] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:49:11 2022] PUT /identity/v3/projects/a7ea8b0f962746ed89bc81d98f83f2f0/users/bab646f098bf4921bc4f42d0c5bb5319/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:11.805234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ef80-a4a9-4e21-a8f7-e3e123d9718b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.805527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ef80-a4a9-4e21-a8f7-e3e123d9718b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.805848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ef80-a4a9-4e21-a8f7-e3e123d9718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.834926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4486ef80-a4a9-4e21-a8f7-e3e123d9718b None None] MFA Rules not processed for user `bab646f098bf4921bc4f42d0c5bb5319`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:11.836211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4486ef80-a4a9-4e21-a8f7-e3e123d9718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:11.905053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1163/2294] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:49:11.916174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:11.917974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:11.940760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:11.981903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc672f-b921-445b-88dd-71e7799b23cc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:11.985714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:11.986455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:11.986774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:11.987069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:11.996537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:11.997999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:12.007002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1132/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:16.267365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:16.269416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:16.269715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:16.289850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:16.291864 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:16.305709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:16.366603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1164/2296] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:16.420681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:16.423051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:16.500582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f981f9f-5c2c-461e-b2be-e045c8cdcd90 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:16.505700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:16.506383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:16.506671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:16.506950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:16.515569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:16.517242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddd247-a558-404e-99d8-e673c84e31fc service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:16.526223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1133/2297] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:23.454535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:23.527118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbcde7-1c10-4bd7-929a-010782844999 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:23.534173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:23.535024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:23.535441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:23.535674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] PATH_INFO: `/v3/users/bab646f098bf4921bc4f42d0c5bb5319` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:23.536971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab646f098bf4921bc4f42d0c5bb5319)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:23.539010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:23.605482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab646f098bf4921bc4f42d0c5bb5319'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:23.606309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab646f098bf4921bc4f42d0c5bb5319'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:23.615118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab646f098bf4921bc4f42d0c5bb5319'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:23.636146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab646f098bf4921bc4f42d0c5bb5319'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:23.645899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab646f098bf4921bc4f42d0c5bb5319'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:23.656283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1165/2298] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:23 2022] DELETE /identity/v3/users/bab646f098bf4921bc4f42d0c5bb5319 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:23.660001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:23.660709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:23.664322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:23.685349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:23.686687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:23.756846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1134/2299] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:23.766549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:23.768249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:23.818973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:23.834694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538685-de4d-4ec8-bf5c-3fd1bed6f5f8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:23.839062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:23.839716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:23.840031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:23.840317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:23.849961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:23.854048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158c40-4092-4d32-b2dd-814f6ac2f8d6 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:23.863429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1166/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:24.191612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:24.193153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:24.219892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881df2-8fd6-4277-8e3f-bf62215ce064 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:24.226827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:24.228117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:24.228444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:24.228726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] PATH_INFO: `/v3/projects/a7ea8b0f962746ed89bc81d98f83f2f0` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:24.230458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ea8b0f962746ed89bc81d98f83f2f0)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:24.232858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:24.310700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:24.312387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ea8b0f962746ed89bc81d98f83f2f0', 'request_id': 'req-a329a8cc-74e0-4b85-b00a-20735ca2b37d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:24.320311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ea8b0f962746ed89bc81d98f83f2f0', 'request_id': 'req-a329a8cc-74e0-4b85-b00a-20735ca2b37d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:24.332124 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ea8b0f962746ed89bc81d98f83f2f0', 'request_id': 'req-a329a8cc-74e0-4b85-b00a-20735ca2b37d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:24.368282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] The token cache is being invalidate because project a7ea8b0f962746ed89bc81d98f83f2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:24.368282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:24.368282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:24.368282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1135/2301] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:24 2022] DELETE /identity/v3/projects/a7ea8b0f962746ed89bc81d98f83f2f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:24.580484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51738c8-b980-4cd9-be25-7eb72d985162 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:24.581050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51738c8-b980-4cd9-be25-7eb72d985162 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:24.581212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51738c8-b980-4cd9-be25-7eb72d985162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:24.603353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b51738c8-b980-4cd9-be25-7eb72d985162 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:24.604810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b51738c8-b980-4cd9-be25-7eb72d985162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:24.668357 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1167/2302] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:49:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:49:24.684249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:24.686177 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:24.769134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329a8cc-74e0-4b85-b00a-20735ca2b37d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:24.776486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:24.777357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:24.777810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:24.778111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:24.787933 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:24.789599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:24.802239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1136/2303] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:25.495127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af739-aadf-4a82-a492-62f1ec66bebe None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:25.495511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af739-aadf-4a82-a492-62f1ec66bebe None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:25.495935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af739-aadf-4a82-a492-62f1ec66bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:25.519970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8a6af739-aadf-4a82-a492-62f1ec66bebe None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:25.522542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8a6af739-aadf-4a82-a492-62f1ec66bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:25.532904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1168/2304] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 20 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:25.557491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:25.573321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa6e4-906a-4661-a1d4-c3569a207fc0 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:25.584413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:25.585317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:25.585783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:25.586078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:25.596624 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:25.598444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:25.613154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1137/2305] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:25.936531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb6f7-6b71-4387-b5b2-5723b6e0029f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:25.937024 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb6f7-6b71-4387-b5b2-5723b6e0029f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:25.938998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb6f7-6b71-4387-b5b2-5723b6e0029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:25.960858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9d6fb6f7-6b71-4387-b5b2-5723b6e0029f None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:25.962116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9d6fb6f7-6b71-4387-b5b2-5723b6e0029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:25.972363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1169/2306] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:49:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:25.983816 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:25.995615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3476-47d4-43d5-82c5-89db29db5e54 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:26.002455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:26.003325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:26.003840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:26.004362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:26.014262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:26.017187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:26.028581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1138/2307] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:26.378799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:26.379163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:26.379523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:26.404733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:26.406806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:26.418728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1170/2308] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 20 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:26.434672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:26.445759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7470-9395-4828-99dc-975edbda4ea2 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:26.451236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:26.451936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:26.452272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:26.452785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:26.461609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:26.463171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8057cba-5ecf-4a9e-8af0-7a2df066218f service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:26.473487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1139/2309] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:29.122011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:29.124492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:29.199907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e53fa6-47dd-4710-ae72-8a589c60ce4c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:29.206369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:29.207410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:29.207812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:29.208225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] PATH_INFO: `/v3/users/3283bab75b9b47a9924eb68fd8ae7bc1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:29.209567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3283bab75b9b47a9924eb68fd8ae7bc1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:29.211668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:29.262679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3283bab75b9b47a9924eb68fd8ae7bc1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.263607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3283bab75b9b47a9924eb68fd8ae7bc1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.272243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3283bab75b9b47a9924eb68fd8ae7bc1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.285519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:29.286886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3283bab75b9b47a9924eb68fd8ae7bc1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.299392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3283bab75b9b47a9924eb68fd8ae7bc1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.305915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1171/2310] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:29 2022] DELETE /identity/v3/users/3283bab75b9b47a9924eb68fd8ae7bc1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:29.310543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:29.311067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:29.311201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:29.329797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:29.331039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:29.404057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1140/2311] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:29.410636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:29.412154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:29.492827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bd3e7-592b-4abb-8693-872126687d47 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:29.497169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:29.497948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:29.498375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:29.498672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:29.512592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:29.514424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32923d8-88ab-4970-9ad4-caa5bd56b8af service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:29.529208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1172/2312] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:29.849748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:29.852269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:29.877232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f60fe-49ac-4148-a72c-5b4e1c5764fd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:29.885075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:29.886081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:29.886449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:29.886853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] PATH_INFO: `/v3/projects/ce96512fcc7c47e8a3a572318630be2b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:29.888473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce96512fcc7c47e8a3a572318630be2b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:29.890660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:29.919737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:29.951404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce96512fcc7c47e8a3a572318630be2b', 'request_id': 'req-a0531afb-4419-448d-b527-d8a63d1a5a2c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.957522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce96512fcc7c47e8a3a572318630be2b', 'request_id': 'req-a0531afb-4419-448d-b527-d8a63d1a5a2c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.973089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce96512fcc7c47e8a3a572318630be2b', 'request_id': 'req-a0531afb-4419-448d-b527-d8a63d1a5a2c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.985945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] The token cache is being invalidate because project ce96512fcc7c47e8a3a572318630be2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:29.986328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.987031 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:29.988992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1141/2313] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:29 2022] DELETE /identity/v3/projects/ce96512fcc7c47e8a3a572318630be2b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:39.176893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:39.177446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:39.177786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:39.197330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:39.198787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:39.271526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1173/2314] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 20 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:49:39.289330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:39.290918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:39.364830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0531afb-4419-448d-b527-d8a63d1a5a2c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:39.370536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:39.371189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:39.371480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:39.371764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:39.380904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:39.382546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:39.393394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1142/2315] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:41.450105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:41.451745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:41.529637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea71cd5-e187-420d-bc0f-ce4ef1e466d4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:41.534722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:41.535201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:41.535537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:41.535796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] PATH_INFO: `/v3/users/0e3dacd75e3a47d9bda05d873826c818` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:41.537285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3dacd75e3a47d9bda05d873826c818)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:41.539350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:41.601111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:41.609272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3dacd75e3a47d9bda05d873826c818'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.610109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3dacd75e3a47d9bda05d873826c818'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.619547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3dacd75e3a47d9bda05d873826c818'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.638322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3dacd75e3a47d9bda05d873826c818'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.647240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-057af0f2-df61-4826-b069-a674ea9320a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3dacd75e3a47d9bda05d873826c818'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.656237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1174/2316] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:41 2022] DELETE /identity/v3/users/0e3dacd75e3a47d9bda05d873826c818 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:41.828526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:41.846752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7e13f-8a9a-4b97-8153-6665a243c12e service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:41.909032 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:41.909902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:41.910195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:41.910469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] PATH_INFO: `/v3/projects/937a900e75b4437b85994fce6c1e3ce4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:41.911683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937a900e75b4437b85994fce6c1e3ce4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:41.913629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:41.963972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:41.978969 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937a900e75b4437b85994fce6c1e3ce4', 'request_id': 'req-916bd6da-892e-46db-bbcf-8af9ee4294c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.989103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937a900e75b4437b85994fce6c1e3ce4', 'request_id': 'req-916bd6da-892e-46db-bbcf-8af9ee4294c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:41.996180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937a900e75b4437b85994fce6c1e3ce4', 'request_id': 'req-916bd6da-892e-46db-bbcf-8af9ee4294c4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.007181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] The token cache is being invalidate because project 937a900e75b4437b85994fce6c1e3ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:42.007467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.008599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-916bd6da-892e-46db-bbcf-8af9ee4294c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.010140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1143/2317] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:41 2022] DELETE /identity/v3/projects/937a900e75b4437b85994fce6c1e3ce4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:42.015775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.016068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.016376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.034166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:42.035356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.094902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1175/2318] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:42.103254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.103552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.103842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.123927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:42.125197 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.134228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1144/2319] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:42.138372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.147967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3bb2-8bf9-46d1-bc79-8f7531b63168 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.153049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.153702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.153991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.154289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.155016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:49:42.155324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.157011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.169827 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1176/2320] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:49:42.173991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.183544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e54e7-2308-413d-ac87-ffdcd99ca468 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.188211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.188883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.189172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.189448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.190157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.192083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.221692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1145/2321] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:42.223113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.234149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5705-71fa-42b9-b670-1b6f3a4079b4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.292499 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.293198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.293485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.293765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.294460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.296429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.317165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1177/2322] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:42.321350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.331909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed0bad-90b3-4dd4-869a-7381f67a77dc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.337414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.338075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.338361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.338639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.339396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.341254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.354511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1146/2323] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:49:42.359779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.373109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db664ad-a019-45a7-8520-a7d6fa383480 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.377926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.378638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.378932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.379210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.379936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.381638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc496c81-4c6a-46f7-9ecf-dab8a89066f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.392438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1178/2324] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:42.396439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.406251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0515fc-3f1e-4764-9a5d-debc35762f32 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.410769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.411631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.411913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.412181 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] PATH_INFO: `/v3/projects/79f46792d64342d68b89b4569a275c32/users/504b1d8819ea43f6b5cc4b8cb5efe837/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.427927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f46792d64342d68b89b4569a275c32, user_id=504b1d8819ea43f6b5cc4b8cb5efe837, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.431283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.446617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1147/2325] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:49:42 2022] PUT /identity/v3/projects/79f46792d64342d68b89b4569a275c32/users/504b1d8819ea43f6b5cc4b8cb5efe837/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:42.456887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34887611-b741-4407-9167-31a656bbede9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.457346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34887611-b741-4407-9167-31a656bbede9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.457460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34887611-b741-4407-9167-31a656bbede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.483932 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-34887611-b741-4407-9167-31a656bbede9 None None] MFA Rules not processed for user `504b1d8819ea43f6b5cc4b8cb5efe837`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:42.485245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34887611-b741-4407-9167-31a656bbede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.494979 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:42.550695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1179/2326] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:42.562652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.564374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.620284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9535-d133-4aed-ae31-b86317d0ac27 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.623862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.624523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.624810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.625086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.641759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.642282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b288e-72ab-424c-9898-6274aa283d2f service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.659086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1148/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:42.688445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34887611-b741-4407-9167-31a656bbede9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.752229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34887611-b741-4407-9167-31a656bbede9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:42.757026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:42.757929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.758238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.758613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] PATH_INFO: `/v3/users/504b1d8819ea43f6b5cc4b8cb5efe837` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.759888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=504b1d8819ea43f6b5cc4b8cb5efe837)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:42.761992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:42.810788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504b1d8819ea43f6b5cc4b8cb5efe837'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.811546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504b1d8819ea43f6b5cc4b8cb5efe837'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.818872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504b1d8819ea43f6b5cc4b8cb5efe837'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.831345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504b1d8819ea43f6b5cc4b8cb5efe837'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.839937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504b1d8819ea43f6b5cc4b8cb5efe837'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:42.846096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1180/2328] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:42 2022] DELETE /identity/v3/users/504b1d8819ea43f6b5cc4b8cb5efe837 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:49:42.850778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:42.851267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:42.851407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:42.870285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:42.871537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.931045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1149/2329] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:42.940624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:42.942048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:42.977176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:43.003398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeab7-f7c2-402d-a861-aa2945f02daa admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:43.007209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:43.007858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:43.008723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:43.009005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:43.018141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:43.019592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:43.030168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1181/2330] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:43.306708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:43.308185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:43.321594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4da612-64d5-43e7-bc53-6a3c04df434d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:43.326374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:43.327853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:43.328142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:43.328456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] PATH_INFO: `/v3/projects/79f46792d64342d68b89b4569a275c32` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:43.329654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f46792d64342d68b89b4569a275c32)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:43.331587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:43.334363 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:43.395653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f46792d64342d68b89b4569a275c32', 'request_id': 'req-c820b6ca-5c9d-4b90-b015-9733eb027f9e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:43.401858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f46792d64342d68b89b4569a275c32', 'request_id': 'req-c820b6ca-5c9d-4b90-b015-9733eb027f9e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:43.409641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f46792d64342d68b89b4569a275c32', 'request_id': 'req-c820b6ca-5c9d-4b90-b015-9733eb027f9e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:43.423989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] The token cache is being invalidate because project 79f46792d64342d68b89b4569a275c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:43.424296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:43.425072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c820b6ca-5c9d-4b90-b015-9733eb027f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:43.426953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1150/2331] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:43 2022] DELETE /identity/v3/projects/79f46792d64342d68b89b4569a275c32 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:45.879836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:45.882056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:45.895733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffba1c-e0e8-4355-883e-c6803aa3fab8 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:45.958134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:45.959194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:45.959625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:45.960096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] PATH_INFO: `/v3/users/a25daa8c4d734a63b3624ff08e23cd46` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:45.961574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25daa8c4d734a63b3624ff08e23cd46)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:45.963521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.018306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25daa8c4d734a63b3624ff08e23cd46'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.018973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25daa8c4d734a63b3624ff08e23cd46'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.026105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25daa8c4d734a63b3624ff08e23cd46'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.038971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25daa8c4d734a63b3624ff08e23cd46'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.046909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25daa8c4d734a63b3624ff08e23cd46'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.053230 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1182/2332] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 13:49:45 2022] DELETE /identity/v3/users/a25daa8c4d734a63b3624ff08e23cd46 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:49:46.058534 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.058972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.059091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.082328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:46.083569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:46.150828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1151/2333] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:49:46.164815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:46.166218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:46.223973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e50a4f-1957-4ecf-b044-2a594cffba06 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:46.227752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:46.228442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.228733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.229015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.236113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:46.239046 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:46.240794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c776b-9c55-43c3-a142-eb1f752d9f05 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.252385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1183/2334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:46.540394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:46.541761 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:46.565721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2166f9f-4acf-4176-98a7-1977f170831e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:46.571848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:46.573157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.573346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.573657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] PATH_INFO: `/v3/projects/1b28b0ed13594df29da0f7508a7d7943` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.575542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b28b0ed13594df29da0f7508a7d7943)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:46.578057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.665308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b28b0ed13594df29da0f7508a7d7943', 'request_id': 'req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.672006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b28b0ed13594df29da0f7508a7d7943', 'request_id': 'req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.680791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b28b0ed13594df29da0f7508a7d7943', 'request_id': 'req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.695822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] The token cache is being invalidate because project 1b28b0ed13594df29da0f7508a7d7943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 13:49:46.696162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.696836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72402001-67ae-4d5f-b9a7-f6c6afb90ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 13:49:46.698389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1152/2335] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 13:49:46 2022] DELETE /identity/v3/projects/1b28b0ed13594df29da0f7508a7d7943 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:46.703852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.704168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.704482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.722707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:46.723928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:46.783211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1184/2336] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:46.791271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.791563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.791846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.810322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:46.811635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:46.819433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1153/2337] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:46.824103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:46.834031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65623c-613e-4717-9e2c-cf360518c5d6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:46.838644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:46.839298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.839589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.839867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.840622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 13:49:46.840931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:46.842532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.854646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1185/2338] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 13:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 13:49:46.858997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:46.868829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb054fa2-5c7e-41c1-8043-eb9da9e9ec01 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:46.873487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:46.874129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.874415 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.874692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.875391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:46.877332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.881365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:46.906256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1154/2339] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:49:46 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:46.908835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:46.919584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097899-400c-49a2-a4f0-6aff8c2d6dea admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:46.974115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:46.974778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:46.975065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:46.975343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:46.976029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:46.978478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:46.998160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1186/2340] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:49:46 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:47.002267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:47.012411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b538a5a-722e-465c-943f-d8a0c5750b58 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:47.016970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:47.017619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:47.017901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:47.018175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:47.018896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:47.020531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:47.030332 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1155/2341] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:47.034020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:47.044349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743c1f-434b-48db-95c7-4e6063696844 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:47.048957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:47.049602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:47.049893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:47.050170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:47.050888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:47.052595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b973179-11b6-4e5e-b667-ffbbe51b756b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:47.063330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1187/2342] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:47.067262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:47.078142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c421-0086-4678-b23b-5d8a3868e7cc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:47.083011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:47.083888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:47.084169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:47.084557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] PATH_INFO: `/v3/projects/3095fe6d8f3740d3b6ab3a9e1cc24c5a/users/257a55c6a7164a49a9b1ca60e2b8cf53/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:47.101065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3095fe6d8f3740d3b6ab3a9e1cc24c5a, user_id=257a55c6a7164a49a9b1ca60e2b8cf53, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:47.103750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:47.116667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1156/2343] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:49:47 2022] PUT /identity/v3/projects/3095fe6d8f3740d3b6ab3a9e1cc24c5a/users/257a55c6a7164a49a9b1ca60e2b8cf53/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:47.121903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706b17-9cc0-486d-b339-da1b2febebfa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:47.122231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706b17-9cc0-486d-b339-da1b2febebfa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:47.122517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706b17-9cc0-486d-b339-da1b2febebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:47.140825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e2706b17-9cc0-486d-b339-da1b2febebfa None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:47.142036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e2706b17-9cc0-486d-b339-da1b2febebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:47.207036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1188/2344] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:47.217482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:47.219354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:47.277764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73815a-0346-4122-b464-8a5616c19be6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:47.281371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:47.282002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:47.282284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:47.282561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:47.291403 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:47.292859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:47.302096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1157/2345] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:49:48.814863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e86b-88c2-45e0-b454-2027c1164d97 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:48.815457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e86b-88c2-45e0-b454-2027c1164d97 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:48.815457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e86b-88c2-45e0-b454-2027c1164d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:48.825993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:48.850580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b5f8e86b-88c2-45e0-b454-2027c1164d97 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:48.853191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b5f8e86b-88c2-45e0-b454-2027c1164d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:48.946977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1189/2346] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:48.963742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:48.972770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:49.106778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58840cd2-64aa-4c7c-80dc-6205b1dec724 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:49.117643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:49.118315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:49.118613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:49.118881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:49.129817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:49.132078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:49.147257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1158/2347] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:49:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:49:53.711580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:53.712035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:53.712383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:53.758362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] MFA Rules not processed for user `257a55c6a7164a49a9b1ca60e2b8cf53`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:49:53.759696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:49:53.874893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1190/2348] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:49:53.879159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:53.893427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b4dcc-9431-482a-8cb3-e7ee194c7271 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:53.909917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:53.910840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:53.911251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:53.911741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:53.912621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:53.915323 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:53.952799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1159/2349] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 13:49:53 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:53.956594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:53.971743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1373a-5077-4a35-9130-0913d7a9bbd9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:54.061831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:54.062677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:54.063072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:54.063455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:54.064747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:54.066805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:54.097084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1191/2350] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 13:49:53 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 13:49:54.098210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:54.112582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff09a7-4fcf-4f22-a76f-229bd6d681a6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:54.119591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:54.120458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:54.121005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:54.121536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:54.122506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:54.124671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:54.148768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1160/2351] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 13:49:54.152915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:54.166010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b664e-923d-4ab0-9d77-25800286fd05 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:54.176109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:54.178413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:54.178730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:54.184477 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] PATH_INFO: `/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded/users/1d9d1a98f094457f9a2290744a55b8c7/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:54.252796 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d22cee9e11a4e5ab2f925e5592d7ded, user_id=1d9d1a98f094457f9a2290744a55b8c7, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:54.257594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:54.287429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1192/2352] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:49:54 2022] PUT /identity/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded/users/1d9d1a98f094457f9a2290744a55b8c7/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 13:49:54.288264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:54.303392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e5ba2-0402-41a8-9ab9-7f9f0526207a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:54.319439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:54.480178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:54.480904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:54.483182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:54.483655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:54.484826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:54.488083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad3fe-5faf-47e6-86d6-2cb78aef69b2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:54.516471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:49:54.522824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:49:54.524371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1161/2353] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 13:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 13:49:54.529888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf75a-6d25-4194-8368-7d8cfed86521 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:49:54.537078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:49:54.537690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:49:54.538051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:49:54.538402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] PATH_INFO: `/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded/users/1d9d1a98f094457f9a2290744a55b8c7/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:49:54.541156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d22cee9e11a4e5ab2f925e5592d7ded, user_id=1d9d1a98f094457f9a2290744a55b8c7, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:49:54.545311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3adbaa-cce4-46ab-a300-7c760ec7e64c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:49:54.566216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1193/2354] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 13:49:54 2022] PUT /identity/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded/users/1d9d1a98f094457f9a2290744a55b8c7/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 13:50:01.778466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:01.778960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:01.779053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:01.801902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] MFA Rules not processed for user `7c1d0edb03914ac69ebdb833ee1c2d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:01.806110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:01.935092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1162/2355] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:02.683224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:02.683805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:02.683805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:02.720657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] MFA Rules not processed for user `1d9d1a98f094457f9a2290744a55b8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:02.721180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:02.832623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1194/2356] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:02.948767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:02.950207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:03.059472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a05e-741d-46c3-9fd5-fc499b6afac8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:03.070488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:03.071150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:03.071549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:03.072007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:03.222967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:03.229195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:03.231178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4665e-233c-4d79-a3ec-3cfbdfbae701 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:03.250098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1163/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:50:03.940132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:03.941607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:04.129689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5492f56-6cd1-4bf3-af95-4c38d127463d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:04.144288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:04.146997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:04.147284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:04.148851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:04.150322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:04.165271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:04.167166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126674e0-f072-4771-9a2b-a37ec2683003 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:04.189816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1195/2358] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:50:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:50:05.486783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6864ef-667a-4141-a4f5-c6cc316b7180 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:05.487692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6864ef-667a-4141-a4f5-c6cc316b7180 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:05.488326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6864ef-667a-4141-a4f5-c6cc316b7180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:05.509017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5b6864ef-667a-4141-a4f5-c6cc316b7180 None None] MFA Rules not processed for user `257a55c6a7164a49a9b1ca60e2b8cf53`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:05.510283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b6864ef-667a-4141-a4f5-c6cc316b7180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:05.526526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1164/2359] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:14.176094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:15.502127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=8 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:16.283188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0af64-709f-48c2-830a-04a9bd85118c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.283714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0af64-709f-48c2-830a-04a9bd85118c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.284027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0af64-709f-48c2-830a-04a9bd85118c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.285743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1196/2360] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:50:16.292951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.293446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.294121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.318941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:16.321587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.365542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479913f-4740-456f-8015-1979305ab58c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.365844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479913f-4740-456f-8015-1979305ab58c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.366246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479913f-4740-456f-8015-1979305ab58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.370283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1165/2361] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:16.379924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:16.383058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.389301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7479913f-4740-456f-8015-1979305ab58c None None] MFA Rules not processed for user `a3e5180dc37741919bc068f5e2302850`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:16.390862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7479913f-4740-456f-8015-1979305ab58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.458935 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77024f93-d7f0-4206-ac00-7068de7f2ee7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:16.462746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:16.463412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.463700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.463993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.476358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:16.477832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1db5f6-693a-4773-a825-d4db46e192bf service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:16.490697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1197/2362] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 13:50:16.493020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1166/2363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 13:50:16.619855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b322d-b20d-4c98-8c8c-db96a5785c88 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.620152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b322d-b20d-4c98-8c8c-db96a5785c88 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.620472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b322d-b20d-4c98-8c8c-db96a5785c88 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.621908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1198/2364] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:50:16.627028 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806df4-d66c-4351-a9a4-bb68ada40262 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.627551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806df4-d66c-4351-a9a4-bb68ada40262 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.628064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806df4-d66c-4351-a9a4-bb68ada40262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.654676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4d806df4-d66c-4351-a9a4-bb68ada40262 None None] MFA Rules not processed for user `c845c75f561740779fe45670aacbd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:16.655929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4d806df4-d66c-4351-a9a4-bb68ada40262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.720739 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1167/2365] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:16.754583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b322d-b20d-4c98-8c8c-db96a5785c88 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:16.766141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b322d-b20d-4c98-8c8c-db96a5785c88 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:16.770570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:16.771462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.771761 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.772047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.789601 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:16.791307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7df4c-43ca-446a-aa42-99e3f7cad46c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:16.800053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1199/2366] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:50:16.919898 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.920336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.920693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.922185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1168/2367] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 20 13:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 13:50:16.927720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b3dc-7964-43a3-bcfc-f34c420ba8a2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.928047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b3dc-7964-43a3-bcfc-f34c420ba8a2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.928368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b3dc-7964-43a3-bcfc-f34c420ba8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:16.947986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3910b3dc-7964-43a3-bcfc-f34c420ba8a2 None None] MFA Rules not processed for user `c6dcc9d0442c49c3ab0f852b91dce5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:16.949245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3910b3dc-7964-43a3-bcfc-f34c420ba8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.958980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1200/2368] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 20 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:16.971798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:16.973559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:16.986608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75437-fb71-41d2-b4b5-0eaf6c39b3ff None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:16.990527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:16.990735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:16.991573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:16.991850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:17.002070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:17.003494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:17.015479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1169/2369] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:50:20.215919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c38dc-d88a-475f-b268-ff6d87d09ad8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:20.216837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c38dc-d88a-475f-b268-ff6d87d09ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:20.217323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c38dc-d88a-475f-b268-ff6d87d09ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:20.245724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b94c38dc-d88a-475f-b268-ff6d87d09ad8 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:20.248054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b94c38dc-d88a-475f-b268-ff6d87d09ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:20.322536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1201/2370] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:20.345735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:20.415717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184cf2-ad6c-4d75-b45f-90c74b3aa96a service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:20.421187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:20.421945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:20.422281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:20.422590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:20.432733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:20.434373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:20.442753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1170/2371] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:50:30.314888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=59 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:30.439267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:41.768765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:41.769225 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:41.769318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:41.787250 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 13:50:41.788485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:50:41.795517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1202/2372] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 20 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 13:50:41.807447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:50:41.817776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a30bf-a7f6-4003-9706-25c82b00a6af service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:50:41.823232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:50:41.823862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:50:41.824144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:50:41.824453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:50:41.833453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:50:41.835162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:50:41.844030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1171/2373] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 13:50:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 13:50:51.782027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:50:51.840569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:51:39.601967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:51:39.613021 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4521d-f7d6-4545-8451-5fd2f4cb8f50 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:51:39.616777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:51:39.617502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:51:39.617831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:51:39.618116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:51:39.627468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:51:39.628948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:51:39.639220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1203/2374] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:51:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:51:49.634866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:05.631056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:52:05.633884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:52:05.707583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13fa21-f96d-4bee-bd5c-bc93c0f21164 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:52:05.711319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:52:05.711972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:52:05.712305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:52:05.712588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:52:05.714398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:52:05.773821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:52:05.775267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:52:05.784136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1172/2375] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:52:11.439459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:52:11.451518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba64a19-6dfa-4fda-89f2-4fbf699766d8 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:52:11.456664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:52:11.457605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:52:11.458041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:52:11.458468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:52:11.461030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:52:11.477068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:52:11.479363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:52:11.491458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1204/2376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:52:14.084604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:52:14.097185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cf753-9779-4e8a-ad13-47aca7a421fb service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:52:14.103135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:52:14.103780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:52:14.104067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:52:14.104383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:52:14.106125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:52:14.162642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:52:14.164859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:52:14.174097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1173/2377] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:52:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:52:21.484650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:24.169696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=76 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:52:41.534266 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:52:41.543637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6ac22-3b83-4569-b6c6-2f0a328b74eb service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:52:41.547396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:52:41.548029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:52:41.548364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:52:41.548638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:52:41.550370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:52:41.560138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:52:41.561592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:52:41.569974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1205/2378] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:52:51.565947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:04.019821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:53:04.029738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046007ec-47cc-40d2-923e-d2851b5b3a53 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:53:04.033642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:53:04.034282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:53:04.034570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:53:04.034852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:53:04.036657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:53:04.049770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:53:04.051203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:53:04.062509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1174/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:53:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:53:14.057345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:19.447897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:53:19.462997 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792c87-9082-4986-af83-b3827fbaea9b service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:53:19.469101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:53:19.469742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:53:19.470082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:53:19.470361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:53:19.472221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:53:19.485392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:53:19.487095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:53:19.498210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1206/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:53:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:53:20.486414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:53:20.495584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163508b0-c110-4f0d-ad32-07ed04ba5b9f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:53:20.500049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:53:20.500778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:53:20.501063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:53:20.501338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:53:20.503158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:53:20.517051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:53:20.518469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:53:20.529274 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1175/2381] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:53:29.493935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:30.524432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:53:40.079906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:53:40.081386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:53:40.093299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af44-4ef7-474b-9812-caeda917e612 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:53:40.096848 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:53:40.097481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:53:40.097762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:53:40.098044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:53:40.099749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:53:40.110306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:53:40.111736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:53:40.120794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1207/2382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:53:50.116723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:03.016487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:55:03.082924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4bdb-5245-44d6-8294-a086a34c2bd9 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:55:03.089416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:55:03.090050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:55:03.090335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:55:03.090613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:55:03.098283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:55:03.099865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:55:03.109473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1176/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:55:12.326800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:55:12.328235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:55:12.395610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b443e-18ac-4d62-b593-586381b047e6 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:55:12.400728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:55:12.401376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:55:12.401376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:55:12.401376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:55:12.410747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:55:12.412298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:55:12.428767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1208/2384] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:55:13.105399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=30 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:55:22.418547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:14.765684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:57:14.777061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547371-579a-4c99-9a1c-8d6d4d98d42d service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:57:14.782524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:57:14.783187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:57:14.783585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:57:14.783871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:57:14.791936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:57:14.794105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:57:14.821902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1177/2385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:57:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:57:16.702670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:57:16.722776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc020ca-5632-4f2b-b304-4430a9a98284 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:57:16.726406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:57:16.727069 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:57:16.727527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:57:16.727814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:57:16.737047 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:57:16.738475 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:57:16.765167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1209/2386] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:57:16.811783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:57:16.821121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87abfc-60b7-4a4f-82dd-1552bbdc8f3d service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:57:16.824989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:57:16.825625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:57:16.825913 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:57:16.826195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:57:16.834641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:57:16.836078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:57:16.863524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1178/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:57:26.762421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=17 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:57:26.860948 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=26 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:58:14.988288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:58:15.008276 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fafe-53c3-4e36-9fe5-a0b27dd3dd51 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:58:15.011868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:58:15.012539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:58:15.012824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:58:15.013100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:58:15.021486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:58:15.022917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:58:15.031139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1210/2388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:58:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:58:25.028001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:17.059489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:59:17.068621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b44e9-ca65-48b2-b8b9-93b972c34ddf service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:59:17.072183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:59:17.072843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:59:17.073131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:59:17.073412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:59:17.084542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:59:17.085977 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:59:17.096967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1179/2389] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:59:17.103766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:59:17.112852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed8c78-c08a-4bce-9e57-e0892e33b502 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:59:17.116349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:59:17.116973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:59:17.117255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:59:17.117533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:59:17.125823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:59:17.127242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:59:17.154651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1211/2390] 10.222.0.17 () {60 vars in 1396 bytes} [Wed Jul 20 13:59:17 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:59:17.242924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:59:17.257603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee5d-e015-4b90-91d6-e8b6c564e002 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:59:17.261744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:59:17.262397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:59:17.262687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:59:17.262966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:59:17.276045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:59:17.277533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:59:17.292416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1180/2391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:59:27.151873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=13 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:27.284764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=12 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 13:59:41.686315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 13:59:41.701362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f93ee-bf9c-4935-833e-393e90417430 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 13:59:41.707252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 13:59:41.709070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 13:59:41.709434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 13:59:41.709792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 13:59:41.711703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 13:59:41.738248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 13:59:41.740000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 13:59:41.750937 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1212/2392] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 13:59:51.746378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:02.788536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:00:02.800259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f8c0c-ed73-45f8-9b27-c22e2ae65773 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:00:02.806881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:00:02.807517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:00:02.807808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:00:02.808092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:00:02.810121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:00:02.842574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:00:02.844178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:00:02.862732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1181/2393] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:00:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:00:12.859996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=19 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:00:17.261138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:00:17.262711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:00:17.329518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67463-bde4-44c7-b77b-867a15004fa4 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:00:17.335216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:00:17.335858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:00:17.336145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:00:17.336460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:00:17.338306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:00:17.350201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:00:17.351778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:00:17.361512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1213/2394] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:00:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:00:27.357349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=32 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:16.567795 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:02:16.569325 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:02:16.641352 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ed3a-3067-441f-accd-027b1e5cb288 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:02:16.647814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:02:16.652938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:02:16.653260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:02:16.653912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:02:16.655903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:02:16.732051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:02:16.733723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:02:16.743464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1182/2395] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:02:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:02:16.840560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:02:16.841970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:02:16.857309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ec6c4-a41d-47ea-be94-80ea8bdb9976 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:02:16.862721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:02:16.863348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:02:16.863634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:02:16.863913 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:02:16.865721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:02:16.936493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:02:16.938092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:02:16.948107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1214/2396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:02:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:02:26.739633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=61 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:02:26.943734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=33 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:17.654893 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:03:17.656495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:03:17.726421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb05-4ce0-4389-b480-512e33a3c664 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:03:17.730103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:03:17.730749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:03:17.731038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:03:17.731319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:03:17.733216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:03:17.811513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:03:17.813009 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:03:17.823098 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1183/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:03:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:03:21.963413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:03:21.965039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:03:22.032083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4ff5-a69a-432d-a567-b4790d0312ab service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:03:22.035712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:03:22.036378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:03:22.036665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:03:22.036946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:03:22.039340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:03:22.048777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:03:22.050207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:03:22.057990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1215/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:03:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:03:27.818306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=58 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:03:32.054539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=31 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:15.640283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:04:15.649870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06aeb0-ad84-4b26-9f7d-b3333787b11a service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:04:15.654280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:04:15.654939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:04:15.655222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:04:15.655503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:04:15.657429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:04:15.670782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:04:15.672232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:04:15.683016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1184/2399] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:04:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:04:16.050173 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:04:16.051757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:04:16.062538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95dba0-dbdf-4923-b78b-96eae457546c service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:04:16.066129 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:04:16.066765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:04:16.067056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:04:16.067340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:04:16.074972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:04:16.089155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:04:16.090598 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:04:16.101775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1216/2400] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:04:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:04:25.678189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:04:26.096708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:03.182924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:03.225768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2aeee-3ce2-473f-bb38-eb9b5ce91a69 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:03.231499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:03.232146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:03.232466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:03.232750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:03.287865 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:03.289507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:03.298322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1185/2401] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:05:13.294320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=41 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:18.967986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:18.993641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add19a85-93c4-4815-b803-1176eaf0bdea service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:18.997295 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:18.997939 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:18.998224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:18.998503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:19.000433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:19.093462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:19.094909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:19.103958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1217/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:05:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:05:21.285634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:21.287607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:21.347485 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df151e5c-5320-4d35-a59f-034fb20c1358 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:21.352597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:21.353236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:21.353524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:21.353805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:21.362372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:21.363960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:21.374235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1186/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:05:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:05:29.099712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=48 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:31.370008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=26 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:42.057722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:42.067699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38b848-36da-4025-b33c-a508bec2ff1b service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:42.071350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:42.072003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:42.072324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:42.072608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:42.074518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:42.158217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:42.159819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:42.179292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1218/2404] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:05:45.301103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:45.311840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ab87-b694-45fd-aaf1-4410784b1e11 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:45.317280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:45.318189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:45.318551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:45.318840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:45.320804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:45.333951 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:45.335880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:45.348287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1187/2405] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:05:48.639039 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:48.641223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:48.658316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7a58-b201-4d70-8f85-995fa707429c service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:48.663099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:48.663978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:48.664303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:48.664585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] PATH_INFO: `/v3/users/257a55c6a7164a49a9b1ca60e2b8cf53` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:48.665779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257a55c6a7164a49a9b1ca60e2b8cf53)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:48.667733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:48.716353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257a55c6a7164a49a9b1ca60e2b8cf53'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:48.716949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257a55c6a7164a49a9b1ca60e2b8cf53'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:48.723958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257a55c6a7164a49a9b1ca60e2b8cf53'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:48.736852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257a55c6a7164a49a9b1ca60e2b8cf53'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:48.743880 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257a55c6a7164a49a9b1ca60e2b8cf53'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:48.749843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1219/2406] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:05:48 2022] DELETE /identity/v3/users/257a55c6a7164a49a9b1ca60e2b8cf53 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:05:48.917231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:48.930579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611ae5-be7f-4665-87f7-7bdc286e46f6 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:48.989567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:48.990432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:48.990720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:48.991002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] PATH_INFO: `/v3/projects/3095fe6d8f3740d3b6ab3a9e1cc24c5a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:48.992179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3095fe6d8f3740d3b6ab3a9e1cc24c5a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:48.994156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:49.039930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'request_id': 'req-fa1db224-60c2-438f-a3ca-62e50c541fd3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.045572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'request_id': 'req-fa1db224-60c2-438f-a3ca-62e50c541fd3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.052888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3095fe6d8f3740d3b6ab3a9e1cc24c5a', 'request_id': 'req-fa1db224-60c2-438f-a3ca-62e50c541fd3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.063958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] The token cache is being invalidate because project 3095fe6d8f3740d3b6ab3a9e1cc24c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:05:49.064277 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.065536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.067164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1188/2407] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:05:48 2022] DELETE /identity/v3/projects/3095fe6d8f3740d3b6ab3a9e1cc24c5a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:05:49.071224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:49.072815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:49.086204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0299fa8-06e1-41d9-9afb-7e8f5904ab47 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:49.120504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:49.145293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:49.146171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:49.146460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:49.146740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] PATH_INFO: `/v3/users/1d9d1a98f094457f9a2290744a55b8c7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:49.160812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9d1a98f094457f9a2290744a55b8c7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:49.162766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:49.207135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9d1a98f094457f9a2290744a55b8c7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.207794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9d1a98f094457f9a2290744a55b8c7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.215056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9d1a98f094457f9a2290744a55b8c7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.227309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9d1a98f094457f9a2290744a55b8c7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.233902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9d1a98f094457f9a2290744a55b8c7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.240529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1220/2408] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:05:49 2022] DELETE /identity/v3/users/1d9d1a98f094457f9a2290744a55b8c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:05:49.412614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:05:49.414427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:05:49.439695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1db224-60c2-438f-a3ca-62e50c541fd3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:05:49.501593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:05:49.502581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:05:49.502866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:05:49.503166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] PATH_INFO: `/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:05:49.514099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d22cee9e11a4e5ab2f925e5592d7ded)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:05:49.516059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:05:49.528501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:49.578180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d22cee9e11a4e5ab2f925e5592d7ded', 'request_id': 'req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.584591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d22cee9e11a4e5ab2f925e5592d7ded', 'request_id': 'req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.591922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d22cee9e11a4e5ab2f925e5592d7ded', 'request_id': 'req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.604398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] The token cache is being invalidate because project 0d22cee9e11a4e5ab2f925e5592d7ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:05:49.604686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.605330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:05:49.606929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1189/2409] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:05:49 2022] DELETE /identity/v3/projects/0d22cee9e11a4e5ab2f925e5592d7ded => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:05:59.236418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:05:59.601179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:19.376436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:07:19.377842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:07:19.444313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2aa57-fc9c-448c-89f8-c699d2ea778d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:07:19.493740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:07:19.494445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:07:19.494712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:07:19.494994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:07:19.496791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:07:19.563211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:07:19.564688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:07:19.582840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1221/2410] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:07:19.670017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:07:19.671965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:07:19.684127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b56f3-4ecd-40a2-b7f6-51e01b231a7e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:07:19.688351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:07:19.688993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:07:19.689281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:07:19.689561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:07:19.691438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:07:19.761842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:07:19.763312 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:07:19.782549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1190/2411] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:07:29.580281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=80 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:07:29.779461 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=36 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:17.208373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:08:17.209855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:08:17.282399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16badfb-3a59-4a2f-b4aa-19db64bcda2b service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:08:17.287943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:08:17.288627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:08:17.288935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:08:17.289219 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:08:17.291417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:08:17.358353 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:08:17.359973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:08:17.378938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1222/2412] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:08:26.587285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:08:26.588770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:08:26.655588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866eb5b-6bb5-4b25-97d2-c696c085702a service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:08:26.659266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:08:26.659943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:08:26.660257 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:08:26.660540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:08:26.662335 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:08:26.671961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:08:26.673434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:08:26.681991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1191/2413] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:08:27.375834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=64 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:08:36.678931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=30 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:16.013118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:16.014545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:16.026999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b0282-8b48-4f16-9538-1110ff2869c8 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:16.030545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:16.031197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:16.031488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:16.031764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:16.033632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:16.047163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:16.048643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:16.059581 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1223/2414] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:16.263638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:16.272158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd441-6e12-4de8-9da2-6d16412f374e service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:16.275755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:16.276421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:16.276714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:16.276991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:16.278757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:16.291708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:16.293179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635b37b-da65-4b19-ae88-690093f41a87 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:16.303837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1192/2415] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:26.054777 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:26.299092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:09:43.118399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:43.120487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:43.174685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33488-07dc-45f1-8a10-96a5eb70f3e8 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:43.184151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:43.185152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:43.185441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:43.185717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:43.192527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:43.232414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:43.234860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:43.259382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1224/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:45.473317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:45.473859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:45.473963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:45.500896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] MFA Rules not processed for user `f9cb52fe271348c1bc0ffda92063bf59`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:09:45.502127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:45.509105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1193/2417] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:09:45.840977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:45.850502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648afd64-6a0e-456e-9692-fb17ba93e197 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:45.854260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:45.854914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:45.855227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:45.855528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:45.857331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:45.866830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:45.868294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:45.876558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1225/2418] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:46.211383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:46.212840 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:46.292984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632ada-ac0c-49cb-a7ff-6e33b7603995 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:46.297997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:46.298658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:46.298942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:46.299220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:46.301073 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:46.313597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:46.315202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:46.326484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1194/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:48.709233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:48.727274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2de-48d5-4185-9505-c48aec7e749a service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:48.733151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:48.734029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:48.734315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:48.734594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:48.736508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:48.751208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:48.752976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:48.766200 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1226/2420] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:52.578353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:09:52.598013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7098-b5cf-44e4-a89a-0ddb0e1c9ac7 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:09:52.603605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:09:52.604641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:09:52.605080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:09:52.605467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:09:52.607367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:09:52.629870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:09:52.631623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:09:52.647753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1195/2421] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:09:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:09:58.760027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=23 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:02.639390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=44 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:19.688143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:10:19.699790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828fb6d-ca45-40b0-a6cf-81c6fda45515 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:10:19.705168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:10:19.705794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:10:19.706078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:10:19.706351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:10:19.708092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:10:19.776437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:10:19.778064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:10:19.796415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1227/2422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:10:25.277043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:10:25.288633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3468-8e9e-47b3-b913-cb36a9755776 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:10:25.293743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:10:25.294387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:10:25.294676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:10:25.294955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:10:25.296744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:10:25.308768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:10:25.310364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:10:25.320138 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1196/2423] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:10:29.793858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=36 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:10:35.316015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:11:42.066072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:11:42.069462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:11:42.080363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc24ffb-9624-467d-b3b4-89cc3144c9de service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:11:42.083974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:11:42.087108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:11:42.087404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:11:42.087685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:11:42.089976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] Could not find project: 3095fe6d8f3740d3b6ab3a9e1cc24c5a.: keystone.exception.ProjectNotFound: Could not find project: 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 20 14:11:42.103737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:11:42.105035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:11:42.106674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:11:42.108351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:11:42.109861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3095fe6d8f3740d3b6ab3a9e1cc24c5a. Jul 20 14:11:42.109861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 20 14:11:42.109861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1228/2424] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:11:42 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 20 14:11:52.094018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:12:20.004860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:12:20.019371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b38bd-63e9-4030-8f61-ae46f654730a service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:12:20.025225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:12:20.026183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:12:20.026986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:12:20.027267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:12:20.035359 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:12:20.036984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:12:20.046379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1197/2425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:12:30.041704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:20.232309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:13:20.240889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4791-7084-40f1-8cdd-071b1390a3b3 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:13:20.244496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:13:20.245128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:13:20.245413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:13:20.245749 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:13:20.254874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:13:20.256342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:13:20.265764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1229/2426] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:13:20.321836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:13:20.331021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209e25-2d16-429f-a717-582bf3d15b92 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:13:20.334644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:13:20.335295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:13:20.335563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:13:20.336097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:13:20.344503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:13:20.345993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:13:20.355248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1198/2427] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:13:29.556543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:13:29.565910 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faa153-d8f2-4e6e-8a5a-a0b6ecd793ba service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:13:29.569500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:13:29.570138 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:13:29.570426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:13:29.570703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:13:29.577888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:13:29.579327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:13:29.587505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1230/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:13:30.351038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:13:39.583732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:16.673304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:14:16.682869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151817f7-60ba-4717-b5b2-e071fdfe6553 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:14:16.686417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:14:16.687051 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:14:16.687376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:14:16.687655 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:14:16.697618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:14:16.699047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:14:16.709607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1199/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:14:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:14:17.812545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:14:17.821144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b129567-b3e7-4280-8826-7c063528459e service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:14:17.824753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:14:17.825387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:14:17.825675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:14:17.825956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:14:17.836853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:14:17.838287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:14:17.849894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1231/2430] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:14:26.704912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:14:27.845133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:20.435012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:20.444322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf845a-8adb-4ef8-a194-e36b3ac30e49 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:20.447904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:20.448577 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:20.448871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:20.449156 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:20.457507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:20.458945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:20.468110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1200/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:15:21.787855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:21.854868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf23b2-e6f7-4f90-a853-b68f5278039d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:21.860736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:21.861415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:21.861700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:21.861978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:21.871355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:21.873016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333998e-f122-4b9b-a861-ace72f7a50fe service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:21.883923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1232/2432] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:15:29.210255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:29.212000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:15:29.280142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf108aa4-3a74-4cb7-bf05-0259228c9690 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:29.285877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:29.286520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:29.286805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:29.287083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:29.295936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:29.297560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:29.307940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1201/2433] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:15:31.879060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:39.303711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=36 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:44.424976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:44.425483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:44.425594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:44.463853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] MFA Rules not processed for user `b55c81544d4342fb89dd8dbce3400fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:15:44.465106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:15:44.471904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1233/2434] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:15:44.773629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:44.783161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed285d-e4e2-41de-9761-fa20e23be9e9 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:44.786871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:44.787506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:44.787793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:44.788080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:44.790278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:15:44.813743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:44.815192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:44.823891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1202/2435] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:15:45.388715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:45.401309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c356-7f2e-4ce4-987b-396873421882 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:45.406323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:45.406973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:45.407404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:45.407691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:45.418661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:45.420638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:45.435030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1234/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:15:52.214500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:52.229070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2842-67cc-4127-a573-2eff1c8ff556 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:52.234701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:52.235341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:52.235627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:52.235903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:52.245203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:52.246784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:52.259054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1203/2437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:15:55.427305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=17 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:15:55.761398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:15:55.774303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845573-798f-4672-94fa-cc65363b3e87 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:15:55.779837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:15:55.780542 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:15:55.780849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:15:55.781125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:15:55.790333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:15:55.791902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:15:55.803161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1235/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:16:02.253118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=17 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:16:05.798082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:17:20.951315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:17:20.952931 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:17:21.031983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccb443-90d1-4ac4-8560-c2cd04f16569 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:17:21.036377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:17:21.037024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:17:21.037313 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:17:21.037593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:17:21.039478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:17:21.105701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:17:21.107140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:17:21.125129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1204/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:17:31.122563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=65 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:18:32.948647 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:18:32.950252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:18:33.015790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567174a-5406-4499-8e78-57da1a33430b service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:18:33.019410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:18:33.020055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:18:33.020378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:18:33.020661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:18:33.022500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:18:33.032336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:18:33.033766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:18:33.042202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1236/2440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:18:43.038150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:19:21.245660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:19:21.254131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72fcf2-aa16-473d-8a3d-f37f2a02310c service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:19:21.257860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:19:21.258497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:19:21.258793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:19:21.259072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:19:21.260987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:19:21.342932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:19:21.344429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:19:21.363007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1205/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:19:21.405156 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:19:21.414737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5453a4-90d7-4c6f-b1d5-c6c021d47f7d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:19:21.418383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:19:21.419014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:19:21.419300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:19:21.419579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:19:21.421453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:19:21.500591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:19:21.502031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:19:21.520673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1237/2442] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:19:31.360328 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=41 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:19:31.517974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=41 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:20:36.762632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:20:36.764308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:20:36.831758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34820c8e-c2a1-4c36-80c4-424bb65573ee service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:20:36.836911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:20:36.837549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:20:36.837835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:20:36.838113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:20:36.839985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:20:36.851862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:20:36.853491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:20:36.863683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1206/2443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:20:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:20:46.858978 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=32 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:21.637771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:21.647413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79f8-bdd6-40d2-b339-3f7738fceaa6 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:21.651210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:21.651862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:21.652153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:21.652472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:21.654359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:21.738824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:21.740813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:21.759942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1238/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:31.757337 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=41 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:41.002992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:41.005701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:41.020346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75621ea-da2b-4121-b0b4-c558c3c9caca service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:41.025039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:41.025688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:41.025975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:41.026251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:41.028165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:41.121132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:41.122599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:41.134924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1207/2445] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:42.109382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:42.120654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81643-ad9c-42be-824f-d7e98e75b392 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:42.124672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:42.125322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:42.125608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:42.125891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:42.128027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:42.268386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:42.268948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:42.270704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:42.286107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe42d-9d2b-4294-924c-a8d28119e5d1 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:42.293862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:42.294527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:42.296779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:42.297069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:42.300581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:42.312313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1239/2446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:42.324466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:42.326034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:42.337244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1208/2447] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:42.389172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:42.391273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:42.412327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f0b8-1f0a-4120-944e-2651818d9904 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:42.421365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:42.422476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:42.423023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:42.423548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:42.427070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:42.441182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:42.442878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:42.455299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1240/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:44.669796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:44.681041 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d657-c8ab-4b5e-9471-52d9f401ca0f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:44.686735 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:44.687853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:44.688412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:44.688919 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:44.691015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:44.717290 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:44.719568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:44.737958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1209/2449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:45.379557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:45.390165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dead4-2398-4dbb-84fe-cef456c1d298 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:45.394284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:45.394936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:45.395224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:45.395506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:45.398535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:45.411546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:45.413111 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:45.423654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1241/2450] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:46.835066 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:46.847512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0b63-13c0-45a1-ae3d-3b0357212873 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:46.857859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:46.858746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:46.859202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:46.859636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:46.861752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:46.879618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:46.881580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:46.894839 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1210/2451] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:46.926342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:46.927985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:46.948130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6534-b693-4862-8257-2fc5e8ecea0e service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:46.954959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:46.955893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:46.956176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:46.956521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] PATH_INFO: `/v3/users/a3e5180dc37741919bc068f5e2302850` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:46.957822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e5180dc37741919bc068f5e2302850)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:46.961369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:47.037829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e5180dc37741919bc068f5e2302850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.038604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e5180dc37741919bc068f5e2302850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.047708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e5180dc37741919bc068f5e2302850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.064570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e5180dc37741919bc068f5e2302850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.073960 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-37fb59e2-4619-4dfe-b97e-0a72402d91e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e5180dc37741919bc068f5e2302850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.084954 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1242/2452] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:46 2022] DELETE /identity/v3/users/a3e5180dc37741919bc068f5e2302850 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:47.487322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:47.502046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4a1ea-1732-43bd-b257-5c610222a6da service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:47.628029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:47.655463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:47.655783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:47.656081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] PATH_INFO: `/v3/projects/1ddc6ae060994d16b13ff53e80813e83` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:47.674501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ddc6ae060994d16b13ff53e80813e83)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:47.676592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:47.778246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:47.795189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ddc6ae060994d16b13ff53e80813e83', 'request_id': 'req-04efb25a-e31b-4c7b-8ada-80c61e20f907'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.816754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ddc6ae060994d16b13ff53e80813e83', 'request_id': 'req-04efb25a-e31b-4c7b-8ada-80c61e20f907'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.829903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ddc6ae060994d16b13ff53e80813e83', 'request_id': 'req-04efb25a-e31b-4c7b-8ada-80c61e20f907'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.842158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] The token cache is being invalidate because project 1ddc6ae060994d16b13ff53e80813e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:47.842789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.843282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-04efb25a-e31b-4c7b-8ada-80c61e20f907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:47.849468 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1211/2453] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:47 2022] DELETE /identity/v3/projects/1ddc6ae060994d16b13ff53e80813e83 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:47.851787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:47.852336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:47.852996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:47.896170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:47.961918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:47.963240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:48.045535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1243/2454] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:48.052823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.053183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.053477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.116324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:48.118392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:48.132715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1212/2455] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:48.137349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.156000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3c11-9bab-4b89-9f80-dfa894862d20 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.167075 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.168316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.168965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.169466 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.170480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:48.171029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.173109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.194129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.200461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1244/2456] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:21:48.207908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff33f5-5a01-4368-ac35-dcfcbe0c027a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.226748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.227446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.232538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.233992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.235067 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.237423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.315674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1213/2457] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:48 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:21:48.319830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.331480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e341-bb91-4821-b872-4f9057fd6a95 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.401891 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.402630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.402919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.403198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.403959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.406036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.438212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1245/2458] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:48 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:48.445492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.467593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b375-9647-4cac-9989-12c38546344e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.473404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.474090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.474379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.474663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.475637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.477963 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.492789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1214/2459] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:48.494296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.505747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f8902-c6fd-47e7-a423-3fa7329cc8e4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.511866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.512467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.513153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.513153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.514130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.516488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc69a87-097f-4513-8840-6b61d605c333 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.532127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1246/2460] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:48.536102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.551094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66887a-93d9-425a-8c95-ef8d9c570277 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.560078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.561744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.562000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.562289 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] PATH_INFO: `/v3/projects/679e4bb7d928493a84a1543d8110a179/users/10219d18fe1746e89396203e3f961e6a/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.582538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679e4bb7d928493a84a1543d8110a179, user_id=10219d18fe1746e89396203e3f961e6a, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.588638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.606558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1215/2461] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:48 2022] PUT /identity/v3/projects/679e4bb7d928493a84a1543d8110a179/users/10219d18fe1746e89396203e3f961e6a/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:48.617985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.618390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.618776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.663089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] MFA Rules not processed for user `10219d18fe1746e89396203e3f961e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:48.664525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:48.704493 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:48.754144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1247/2462] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:48.762882 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.764659 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:48.854235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a49d-e7cc-4696-b0c9-5b728c8cc993 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:48.858003 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:48.858662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:48.858956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:48.859240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:48.869024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:48.870492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:48.881386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1216/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:48.893688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.896170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:48.937322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:48.938793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.039090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0c27-becd-404d-b648-3aa8ce5f12d7 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.046776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.048619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.049173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.049697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.052167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.062658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db737f-79f2-423f-bd7f-841e9210fd27 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.068436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.069654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.069943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.070224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.071366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:49.072126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.086414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.088371 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.100810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1248/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:49.101712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:49.103526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.163088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.165552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.186673 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1217/2465] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:49.188167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:49.190382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.207548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e881f2d-19d4-47cc-b03a-ca879d16640e service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.208172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae307-f3ad-4ba6-9d72-c7eb8943bacb service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.214629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.215772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.216234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.216501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.216720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] PATH_INFO: `/v3/users/f9cb52fe271348c1bc0ffda92063bf59` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.217579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.217868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.218142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] PATH_INFO: `/v3/users/b55c81544d4342fb89dd8dbce3400fe4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.218446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cb52fe271348c1bc0ffda92063bf59)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.219617 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55c81544d4342fb89dd8dbce3400fe4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.220792 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.221802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.310512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cb52fe271348c1bc0ffda92063bf59'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.321745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55c81544d4342fb89dd8dbce3400fe4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.323686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55c81544d4342fb89dd8dbce3400fe4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.332550 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55c81544d4342fb89dd8dbce3400fe4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.333614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cb52fe271348c1bc0ffda92063bf59'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.353335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:49.355131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cb52fe271348c1bc0ffda92063bf59'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.362484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55c81544d4342fb89dd8dbce3400fe4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.367876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cb52fe271348c1bc0ffda92063bf59'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.369069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cb52fe271348c1bc0ffda92063bf59'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.375023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55c81544d4342fb89dd8dbce3400fe4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.379647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1218/2466] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:49 2022] DELETE /identity/v3/users/f9cb52fe271348c1bc0ffda92063bf59 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:49.382423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1249/2467] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:49 2022] DELETE /identity/v3/users/b55c81544d4342fb89dd8dbce3400fe4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:49.595080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:49.597296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.685712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2ab8-0b0d-45dc-a55b-4040d175cb5f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.706692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:49.754282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.755159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.755447 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.755736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] PATH_INFO: `/v3/projects/ef1e44c6f9fc41ffaf49a0fec012031b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.756979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1e44c6f9fc41ffaf49a0fec012031b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.758937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.783131 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:49.785377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.800823 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b1bf0-3886-4fd7-a676-fea00b769702 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:49.815112 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'request_id': 'req-f9e51413-9ade-4108-8886-027742b745aa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.825637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'request_id': 'req-f9e51413-9ade-4108-8886-027742b745aa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.837221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1e44c6f9fc41ffaf49a0fec012031b', 'request_id': 'req-f9e51413-9ade-4108-8886-027742b745aa'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.850943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] The token cache is being invalidate because project ef1e44c6f9fc41ffaf49a0fec012031b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:49.851235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.852122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f9e51413-9ade-4108-8886-027742b745aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.854053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1219/2468] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:49 2022] DELETE /identity/v3/projects/ef1e44c6f9fc41ffaf49a0fec012031b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:49.860201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72079-0a16-4260-af13-b1ae740e0913 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.860803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72079-0a16-4260-af13-b1ae740e0913 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.860924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a72079-0a16-4260-af13-b1ae740e0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.876286 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:49.877227 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.877575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.877920 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] PATH_INFO: `/v3/projects/cc6c042204f0471ba5c2f8a67604a802` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.879211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6c042204f0471ba5c2f8a67604a802)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:49.880937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-83a72079-0a16-4260-af13-b1ae740e0913 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:49.882054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:49.883453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-83a72079-0a16-4260-af13-b1ae740e0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.896440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1220/2469] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:49.901505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.902015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.902154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.920330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:49.921553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:49.937325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6c042204f0471ba5c2f8a67604a802', 'request_id': 'req-d4138d44-8108-4e5e-8f0c-723fc6e53836'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.946123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6c042204f0471ba5c2f8a67604a802', 'request_id': 'req-d4138d44-8108-4e5e-8f0c-723fc6e53836'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.954016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6c042204f0471ba5c2f8a67604a802', 'request_id': 'req-d4138d44-8108-4e5e-8f0c-723fc6e53836'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.967999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] The token cache is being invalidate because project cc6c042204f0471ba5c2f8a67604a802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:49.968368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.969258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d4138d44-8108-4e5e-8f0c-723fc6e53836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:49.971324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1250/2470] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:49 2022] DELETE /identity/v3/projects/cc6c042204f0471ba5c2f8a67604a802 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:49.977492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884c6d-665e-4fd9-bfc0-29742105c0d3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:49.977863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884c6d-665e-4fd9-bfc0-29742105c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:49.978221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884c6d-665e-4fd9-bfc0-29742105c0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:49.993827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1221/2471] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:49.998036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:49.999976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2f884c6d-665e-4fd9-bfc0-29742105c0d3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:50.001236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f884c6d-665e-4fd9-bfc0-29742105c0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.009117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c8110-4068-48a9-873b-7e2c78391438 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.016964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1251/2472] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:50.017152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.017152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.017152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.017152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.017580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:50.017580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.018020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.019505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.019872 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.020241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.034813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1222/2473] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:21:50.035942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.040416 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:50.041624 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.054244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1252/2474] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:50.054456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33fe13-9115-4711-bbec-4a6fb56a5bd1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.055281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.058899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.059596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.060048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.060371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.061216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.063934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.064600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4c8e0-3000-4ce2-89ce-12f9cc46beba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.070127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.070790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.071080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.071355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.072083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:50.072424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.074053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.087341 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1253/2475] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:21:50.092334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.102040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1223/2476] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:50.102347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb4fb2-f42f-4a8f-90fc-52adf3080dbf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.106113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.120968 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:50.153451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:50.168333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.169004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.169300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.169630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.170334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.172385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.187979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153a9f5-acf1-45a5-9d31-162a82004fd5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.193376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.194570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.194859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.195141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.195950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.197953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.201667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1254/2477] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:50.205589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.220908 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1224/2478] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:50.226320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.239487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf1df-1386-40b2-90aa-9d8e2cf581b7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.283506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8f25-95b8-4d02-bdec-fd58c0d66a91 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.290986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.291615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.291901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.292177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.292952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.295253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.309350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.309864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.310483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.310619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.312515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.315261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.327799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1255/2479] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:21:50.332253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.336356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1225/2480] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:50.340788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.344857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c7ae-2f27-41a5-bf7c-dfcf7f73e095 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.349715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.351372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.351372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.351372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.351707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.353345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.357621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b475-80f9-45e1-9821-974ab96e5078 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.362965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.363867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.364369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.364817 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.366255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.368510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.372180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1256/2481] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:50.377517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.384575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1226/2482] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:50.389053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.393738 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d615-b03f-40c7-946d-352c7959cf08 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.400668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.401708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.402068 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.402430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.403241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.405254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.406831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1355-7f47-40ff-86fc-cc061e29dfcf admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.412511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.413493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.413857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.414218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] PATH_INFO: `/v3/projects/f2321a0eb5ea4a99864bcbff6365d538/users/c2aa9f2c386647998cff8688be616660/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.428916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1257/2483] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:50.429835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.443209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493fb3-7199-4c39-8bcd-5198a28197b5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.446373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2321a0eb5ea4a99864bcbff6365d538, user_id=c2aa9f2c386647998cff8688be616660, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.448888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.449293 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18446b03-f226-4cc6-875f-dda722f01c01 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.449792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.450100 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.450355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] PATH_INFO: `/v3/projects/2df4654d37184ca4880e6972c2ad72f6/users/f77008d7da3f4c4689dc72fab6cfaf68/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.473231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4654d37184ca4880e6972c2ad72f6, user_id=f77008d7da3f4c4689dc72fab6cfaf68, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.476426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e136b-94b3-4f1d-b99f-c9594d8ac43e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.483100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1227/2484] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:50 2022] PUT /identity/v3/projects/f2321a0eb5ea4a99864bcbff6365d538/users/c2aa9f2c386647998cff8688be616660/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:50.488618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.489281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.490291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.491358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1258/2485] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:50 2022] PUT /identity/v3/projects/2df4654d37184ca4880e6972c2ad72f6/users/f77008d7da3f4c4689dc72fab6cfaf68/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:50.496885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.498117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.498917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.538145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:50.540179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:50.541114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.542177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.630228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1228/2486] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:50.639603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.641449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.654764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:50.668797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1259/2487] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:50.677835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:50.681765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:50.705010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:50.728715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a155-8ca0-4bb5-9f53-bfc258913ce9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.732492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.733145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.733432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.733716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.744740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.746206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565529a-efe0-4406-8118-37e499ed168f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.751674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519e25-a9a8-4e73-bdb3-2d0b3e0f493a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:50.755800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:50.757546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:50.757694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1229/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:50.757790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:50.757790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:50.768182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:50.769789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:50.781916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1260/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:52.029488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.030641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.030998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.070724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] MFA Rules not processed for user `f77008d7da3f4c4689dc72fab6cfaf68`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:52.073731 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:52.186409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1230/2490] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:52.187986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.201212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e9db-1b0a-4d90-a77e-2aa88e590dda service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.206431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.207389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.208060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.208929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.209894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.212122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.253801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1261/2491] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:52 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:52.254669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.270367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01602c-c9e7-4dc6-9e6b-a8f6591ebad8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.362750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.363836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.363836 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.364050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.365227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.369246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.405604 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1231/2492] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:52 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:52.407482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.423369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2872a1-4559-4e5a-af27-a541a5d92a2a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.430244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.431586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.432228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.432519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.433391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.435247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.457359 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1262/2493] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:52.464050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.477794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a669e5-dc87-4609-910b-a18665e6e1d2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.495406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.496628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.498664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.499108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] PATH_INFO: `/v3/projects/e62d32aa852944f3af1c0855195e54d5/users/ea8c6e4ef8074cfaa1b720b5f3523765/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.527764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62d32aa852944f3af1c0855195e54d5, user_id=ea8c6e4ef8074cfaa1b720b5f3523765, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.531638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.549937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1232/2494] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:52 2022] PUT /identity/v3/projects/e62d32aa852944f3af1c0855195e54d5/users/ea8c6e4ef8074cfaa1b720b5f3523765/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:52.553697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.565519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6037-ef71-4ae0-b75c-b7166846c9bc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.686006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.687001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.687338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.687673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.688450 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.690197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.708691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1263/2495] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:52.709665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:52.718386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:52.726685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3aeb0-2bc3-4728-b4bc-c3b503d8ee57 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:52.737282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:52.738750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:52.739038 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:52.739476 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] PATH_INFO: `/v3/projects/e62d32aa852944f3af1c0855195e54d5/users/ea8c6e4ef8074cfaa1b720b5f3523765/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:52.742351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62d32aa852944f3af1c0855195e54d5, user_id=ea8c6e4ef8074cfaa1b720b5f3523765, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:52.745550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:52.766469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1233/2496] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:52 2022] PUT /identity/v3/projects/e62d32aa852944f3af1c0855195e54d5/users/ea8c6e4ef8074cfaa1b720b5f3523765/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:53.259535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:53.261319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:53.282717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54da0-4955-4a2c-a257-0ea61aecfcdb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:53.372377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:53.373347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:53.373575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:53.373863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] PATH_INFO: `/v3/users/7c1d0edb03914ac69ebdb833ee1c2d75` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:53.375747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1d0edb03914ac69ebdb833ee1c2d75)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:53.377625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:53.423594 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:53.456809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1d0edb03914ac69ebdb833ee1c2d75'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:53.460852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1d0edb03914ac69ebdb833ee1c2d75'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:53.491158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1d0edb03914ac69ebdb833ee1c2d75'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:53.508113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1d0edb03914ac69ebdb833ee1c2d75'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:53.521202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-84cb28c4-3e3d-4230-b6f7-fbcb9d38faaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1d0edb03914ac69ebdb833ee1c2d75'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:53.533028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1264/2497] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:53 2022] DELETE /identity/v3/users/7c1d0edb03914ac69ebdb833ee1c2d75 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:53.997544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.000150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:54.015945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57941d6a-f706-41cf-bee3-d4b386567792 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.104037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391865-70ec-4c7e-930e-58e71b3b5b0d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.104532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391865-70ec-4c7e-930e-58e71b3b5b0d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.106431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391865-70ec-4c7e-930e-58e71b3b5b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.132281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.134146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.134535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.135456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] PATH_INFO: `/v3/projects/4d8105a57b2a47d5851fc8ca3d13c9e3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.137030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8105a57b2a47d5851fc8ca3d13c9e3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.139801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.149969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-64391865-70ec-4c7e-930e-58e71b3b5b0d None None] MFA Rules not processed for user `ea8c6e4ef8074cfaa1b720b5f3523765`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:54.151579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64391865-70ec-4c7e-930e-58e71b3b5b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:54.211764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'request_id': 'req-2c5a891c-0b07-420c-8da4-af396b012117'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:54.219746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'request_id': 'req-2c5a891c-0b07-420c-8da4-af396b012117'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:54.231126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8105a57b2a47d5851fc8ca3d13c9e3', 'request_id': 'req-2c5a891c-0b07-420c-8da4-af396b012117'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:54.252644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] The token cache is being invalidate because project 4d8105a57b2a47d5851fc8ca3d13c9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:54.252644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:54.253062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c5a891c-0b07-420c-8da4-af396b012117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:54.255709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1234/2498] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:53 2022] DELETE /identity/v3/projects/4d8105a57b2a47d5851fc8ca3d13c9e3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:54.258289 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1265/2499] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:54.262737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.263027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.263308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.298351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:54.300012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:54.380349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1235/2500] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:54.386112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.386575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.386675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.407139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:54.408843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:54.421806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1266/2501] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:54.422505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.434756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249310b3-2ce1-4dcc-b612-fb974771b24d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.440065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.440779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.441065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.441342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.442136 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:54.442445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.445095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.466525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1236/2502] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:21:54.471596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.483429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8adb-4020-48fd-8034-b9568f24b7c9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.489007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.490188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.491218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.491698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.492643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.494990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.528262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1267/2503] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:54.532555 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.543892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c304f14-9102-4167-be4a-6e0275555c1c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.548322 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:54.627791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.628896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.629270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.629647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.630449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.632609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.669986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1237/2504] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:54.675274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.702883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4be4-1b1d-4ad6-9d0c-4ee173d5f942 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.712012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.712912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.713269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.713653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.714626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.716408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.734894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1268/2505] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:54.736329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.748423 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96350-e970-4b93-b7ad-aebd45c022e7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.754216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.754986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.755367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.755724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.757202 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.758873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee287d-3a42-4df5-b692-6b059adcd008 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.772367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1238/2506] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:54.776697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:54.789007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3f301-8858-4229-b5fc-8f84b3399cff admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:54.794410 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:54.795321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.796044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.796044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] PATH_INFO: `/v3/projects/82828340410840929f41f91dc53bc51e/users/d6e6cfac79024ce99058f272249f2b49/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.817654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82828340410840929f41f91dc53bc51e, user_id=d6e6cfac79024ce99058f272249f2b49, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:54.820486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:54.841247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1269/2507] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:54 2022] PUT /identity/v3/projects/82828340410840929f41f91dc53bc51e/users/d6e6cfac79024ce99058f272249f2b49/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:54.850920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:54.851244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:54.851500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:54.891861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] MFA Rules not processed for user `d6e6cfac79024ce99058f272249f2b49`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:54.893230 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:54.976734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1239/2508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:54.981040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.036417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:55.137865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59d3dc-83a2-4279-94c9-bf729d1de80e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.148635 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.154957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.155293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.155571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.156454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.159809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.246218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1270/2509] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:54 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:55.250262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.279024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc79bf-7348-4c89-91e1-f4399cd3b4e9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.398578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.399273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.399790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.400171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.403800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.411510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.468637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1240/2510] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:55 2022] POST /identity/v3/users => generated 308 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:55.473404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.489605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03e41-f283-429f-b92b-95a52033cfe5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.498054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.499139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.499480 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.499770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.501725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.507404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.526291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1271/2511] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:55.528043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.537834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:55.544719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5507-8ab2-4098-8773-88977fd1e692 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.558222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.560474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.563516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.564043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] PATH_INFO: `/v3/projects/016af67b4f084dc7a6e3375593cde790/users/1cd71d99493a4cc9aed7925e073292ca/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.587159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] RBAC: Authorizing `identity:create_grant(project_id=016af67b4f084dc7a6e3375593cde790, user_id=1cd71d99493a4cc9aed7925e073292ca, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.589942 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.624059 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1241/2512] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:55 2022] PUT /identity/v3/projects/016af67b4f084dc7a6e3375593cde790/users/1cd71d99493a4cc9aed7925e073292ca/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:55.624986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.653838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6fa8-9898-47d1-80d9-21e704bab6dc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.762553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.763245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.763609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.763970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.764998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.767838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.782399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1272/2513] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:55.788318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.807092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233f79-4204-4107-89f8-857a2c25786e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.816852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.819663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.820516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.822502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] PATH_INFO: `/v3/projects/016af67b4f084dc7a6e3375593cde790/users/1cd71d99493a4cc9aed7925e073292ca/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.825278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] RBAC: Authorizing `identity:create_grant(project_id=016af67b4f084dc7a6e3375593cde790, user_id=1cd71d99493a4cc9aed7925e073292ca, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.834250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f403f-0768-4a74-80c8-df22f129466b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:55.851029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1242/2514] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:55 2022] PUT /identity/v3/projects/016af67b4f084dc7a6e3375593cde790/users/1cd71d99493a4cc9aed7925e073292ca/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:55.862253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:55.863993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.864122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:55.864465 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.864866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.879843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983cd0-156c-4863-8d75-14a420e0c877 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:55.903515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] MFA Rules not processed for user `1cd71d99493a4cc9aed7925e073292ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:55.905229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:55.959029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:55.959952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:55.961127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:55.961426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] PATH_INFO: `/v3/users/f77008d7da3f4c4689dc72fab6cfaf68` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:55.962713 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77008d7da3f4c4689dc72fab6cfaf68)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:55.964942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:56.018052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1243/2515] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:56.030712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:56.031053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:56.032885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:56.044813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77008d7da3f4c4689dc72fab6cfaf68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.046423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77008d7da3f4c4689dc72fab6cfaf68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.058981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77008d7da3f4c4689dc72fab6cfaf68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.082398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77008d7da3f4c4689dc72fab6cfaf68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.096397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77008d7da3f4c4689dc72fab6cfaf68'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.104534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1273/2516] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:55 2022] DELETE /identity/v3/users/f77008d7da3f4c4689dc72fab6cfaf68 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:56.151907 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a53dd4-7cd6-4027-811a-78ca827a0e9f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:56.270988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:56.272242 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:56.272526 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:56.273049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:56.275522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:56.315807 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:56.403147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:56.406356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:56.419435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:56.422019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:56.423721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1244/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:56.517324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989ee1-a807-485f-a0b9-ab32cff58e09 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:56.525162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:56.526132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:56.526421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:56.526701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] PATH_INFO: `/v3/projects/2df4654d37184ca4880e6972c2ad72f6` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:56.527958 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df4654d37184ca4880e6972c2ad72f6)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:56.530514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:56.592083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df4654d37184ca4880e6972c2ad72f6', 'request_id': 'req-83c92b2f-edc2-49b2-99a2-94b6264f2910'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.602782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df4654d37184ca4880e6972c2ad72f6', 'request_id': 'req-83c92b2f-edc2-49b2-99a2-94b6264f2910'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.610176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df4654d37184ca4880e6972c2ad72f6', 'request_id': 'req-83c92b2f-edc2-49b2-99a2-94b6264f2910'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.622885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] The token cache is being invalidate because project 2df4654d37184ca4880e6972c2ad72f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:56.623314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.624048 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.625948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1274/2518] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:56 2022] DELETE /identity/v3/projects/2df4654d37184ca4880e6972c2ad72f6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:56.629687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:56.663088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9be0-ddb6-44e3-9da3-e1d1e4e45ee9 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:56.756724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:56.758184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:56.758658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:56.759068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] PATH_INFO: `/v3/users/ea8c6e4ef8074cfaa1b720b5f3523765` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:56.760454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8c6e4ef8074cfaa1b720b5f3523765)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:56.762455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:56.859957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8c6e4ef8074cfaa1b720b5f3523765'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.881513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8c6e4ef8074cfaa1b720b5f3523765'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.893303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:56.895087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:56.902424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8c6e4ef8074cfaa1b720b5f3523765'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.913145 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92b2f-edc2-49b2-99a2-94b6264f2910 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:56.914883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8c6e4ef8074cfaa1b720b5f3523765'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.915567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-67b19fcd-8698-4fca-995b-b19d26869093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8c6e4ef8074cfaa1b720b5f3523765'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.918846 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:56.919746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:56.920034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:56.920350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] PATH_INFO: `/v3/users/d6e6cfac79024ce99058f272249f2b49` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:56.921646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e6cfac79024ce99058f272249f2b49)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:56.923829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:56.927830 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1245/2519] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:56 2022] DELETE /identity/v3/users/ea8c6e4ef8074cfaa1b720b5f3523765 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:56.966848 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:56.967192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:56.968152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:56.980945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:56.996042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e6cfac79024ce99058f272249f2b49'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:56.996788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e6cfac79024ce99058f272249f2b49'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.016719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e6cfac79024ce99058f272249f2b49'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.028856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] MFA Rules not processed for user `c2aa9f2c386647998cff8688be616660`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:57.046657 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.054715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e6cfac79024ce99058f272249f2b49'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.069148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0b75da38-0c19-45f6-87a8-dd2b868c1a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e6cfac79024ce99058f272249f2b49'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.079936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1275/2520] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:56 2022] DELETE /identity/v3/users/d6e6cfac79024ce99058f272249f2b49 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:57.081040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:57.082789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.083540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.085736 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.118947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:57.120268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.157353 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1246/2521] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:57.165774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.167663 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.244923 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1276/2522] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:57.254726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.256859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.332475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25ba5a-9da6-4d49-a201-4d9ab23ff3a3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:57.358307 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071ea8-14ac-4d93-bae0-f2d031eb91a1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:57.363032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:57.363747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.364179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.364500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.378978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:57.380507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:57.392342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1277/2523] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:21:57.393269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.394926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.433274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e7e99-1f25-4f65-960c-05b1961cfc45 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:57.444288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:57.444288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.444288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.444288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] PATH_INFO: `/v3/projects/e62d32aa852944f3af1c0855195e54d5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.465298 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62d32aa852944f3af1c0855195e54d5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:57.472946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:57.474052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:57.475504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.475856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.476351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.551563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62d32aa852944f3af1c0855195e54d5', 'request_id': 'req-cec3e18d-8de8-41de-b042-248d77ea30ee'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.556930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:57.566238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62d32aa852944f3af1c0855195e54d5', 'request_id': 'req-cec3e18d-8de8-41de-b042-248d77ea30ee'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.575045 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62d32aa852944f3af1c0855195e54d5', 'request_id': 'req-cec3e18d-8de8-41de-b042-248d77ea30ee'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.579887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:57.581881 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1701716-ea1b-488a-9709-05fd0bd2c527 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:57.590292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] The token cache is being invalidate because project e62d32aa852944f3af1c0855195e54d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:57.590661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.591263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec3e18d-8de8-41de-b042-248d77ea30ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:57.593122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1278/2524] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:57 2022] DELETE /identity/v3/projects/e62d32aa852944f3af1c0855195e54d5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:57.596590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1247/2525] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:57.598278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.598577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.598861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.619205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:57.620465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.806746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1279/2526] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:57.813632 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.813899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.814164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.821668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:57.852173 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:57.854025 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:57.865622 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1248/2527] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:57.870365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.883101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae05609-5dbc-4434-9caa-3251b3ccbda6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:57.888695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:57.889395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.890299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.890597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.891318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:57.891620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:57.893271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:57.911649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1280/2528] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:21:57.913150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.923597 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fe3cc-2553-460e-ad50-3fd7049da88e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:57.929573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:57.930268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:57.930556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:57.930850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:57.931608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:57.933571 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:57.964429 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1249/2529] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:57 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:57.968697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:57.980798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51820d-b074-4e19-a478-ed5b9a11bac6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.057538 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.058147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.058427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.058702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.059413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.061612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.071612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.073918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:58.087370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1281/2530] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:57 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:58.091712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.095668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3257dd-93d2-4e94-b4f4-ceb13cb883d4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.102503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.104117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.104557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.104936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] PATH_INFO: `/v3/projects/82828340410840929f41f91dc53bc51e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.105157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de23f-8a8b-4359-a027-e35a00b3c1f1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.107399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=82828340410840929f41f91dc53bc51e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.110163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.113389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.114085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.114372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.114659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.115400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.117177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.128726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1282/2531] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:58.133678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.145951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bef570-ea5f-4a72-95fc-7e420239d80b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.151942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.152709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.153002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.153280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.154019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.155660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.176667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1283/2532] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:58.177689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.181744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82828340410840929f41f91dc53bc51e', 'request_id': 'req-6aa98280-8699-471b-ab86-6b1eead65eef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.188079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82828340410840929f41f91dc53bc51e', 'request_id': 'req-6aa98280-8699-471b-ab86-6b1eead65eef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.189955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb4b1e-2233-4889-912d-ff352b434f62 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.198894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82828340410840929f41f91dc53bc51e', 'request_id': 'req-6aa98280-8699-471b-ab86-6b1eead65eef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.213501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] The token cache is being invalidate because project 82828340410840929f41f91dc53bc51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:58.213501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.214097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.216146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1250/2533] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:58 2022] DELETE /identity/v3/projects/82828340410840929f41f91dc53bc51e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:58.219932 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.221917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:58.236645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:58.279837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.281031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.281158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.281644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] PATH_INFO: `/v3/projects/296ab440b5f84772bd8e82b5ea69e727/users/775c06d25c724f4d9839c7e87e67f483/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.306811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa98280-8699-471b-ab86-6b1eead65eef admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.312031 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296ab440b5f84772bd8e82b5ea69e727, user_id=775c06d25c724f4d9839c7e87e67f483, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.312128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.313078 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.313373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.313654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] PATH_INFO: `/v3/users/1cd71d99493a4cc9aed7925e073292ca` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.314897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd71d99493a4cc9aed7925e073292ca)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.315698 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9ec69-064c-4734-91cb-7746a1c7a189 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.316897 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.348980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1284/2534] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:58 2022] PUT /identity/v3/projects/296ab440b5f84772bd8e82b5ea69e727/users/775c06d25c724f4d9839c7e87e67f483/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:58.359434 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.360379 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.360867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.379961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd71d99493a4cc9aed7925e073292ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.389736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:58.391106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] MFA Rules not processed for user `775c06d25c724f4d9839c7e87e67f483`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:58.392664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:58.397443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd71d99493a4cc9aed7925e073292ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.410701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd71d99493a4cc9aed7925e073292ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.420956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd71d99493a4cc9aed7925e073292ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.421616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd71d99493a4cc9aed7925e073292ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.431998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1251/2535] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:21:58 2022] DELETE /identity/v3/users/1cd71d99493a4cc9aed7925e073292ca => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:58.485556 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1285/2536] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:58.490163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.492625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:58.599585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3f4db-e990-4cf2-a7d4-0565cd561e5a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.613921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.614642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.615409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.615699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.617064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.626259 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.667170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1252/2537] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:58 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:21:58.668879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.757309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.759405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:58.763918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccd40e-399c-4ccf-9574-696e4752d931 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.838462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:58.846669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.847691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.848294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.848731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.849644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.851896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.877892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1286/2538] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:58 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:58.881650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.888455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3949-7107-4d9c-936c-181af354dc3b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.899496 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.899893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d110d79-f5d1-4ca1-ac32-111577f48b4d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.900564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.900853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.901134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] PATH_INFO: `/v3/projects/016af67b4f084dc7a6e3375593cde790` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.902407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=016af67b4f084dc7a6e3375593cde790)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.904394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.911514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:58.912484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:58.912970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:58.913507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:58.914781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:58.917293 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:58.931226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1287/2539] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:21:58.935806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:58.950951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2ec41-63a7-4673-a3ab-3b9b4d5e0d0b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:58.973088 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016af67b4f084dc7a6e3375593cde790', 'request_id': 'req-c53a647e-25f9-47de-841b-101dd5c84a9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:58.979891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016af67b4f084dc7a6e3375593cde790', 'request_id': 'req-c53a647e-25f9-47de-841b-101dd5c84a9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:59.003279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:59.013252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016af67b4f084dc7a6e3375593cde790', 'request_id': 'req-c53a647e-25f9-47de-841b-101dd5c84a9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:59.045145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] The token cache is being invalidate because project 016af67b4f084dc7a6e3375593cde790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:21:59.045453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:59.047164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c53a647e-25f9-47de-841b-101dd5c84a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:21:59.050240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1253/2540] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:21:58 2022] DELETE /identity/v3/projects/016af67b4f084dc7a6e3375593cde790 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:59.056221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9222ac-8624-46a9-aa46-54c9b6d2c75e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.056221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9222ac-8624-46a9-aa46-54c9b6d2c75e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.056459 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9222ac-8624-46a9-aa46-54c9b6d2c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.066115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.069283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.072537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.074874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] PATH_INFO: `/v3/projects/e5d342da8afe425ba4478130414b5b3b/users/fb5ffe99569d4ae9a9f225bd2b6670f1/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.089091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-da9222ac-8624-46a9-aa46-54c9b6d2c75e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:59.090279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-da9222ac-8624-46a9-aa46-54c9b6d2c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.103351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1254/2541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:59.112346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.112803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.113435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.116657 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d342da8afe425ba4478130414b5b3b, user_id=fb5ffe99569d4ae9a9f225bd2b6670f1, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.119356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.135531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:59.136896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.140439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1288/2542] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:58 2022] PUT /identity/v3/projects/e5d342da8afe425ba4478130414b5b3b/users/fb5ffe99569d4ae9a9f225bd2b6670f1/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:21:59.143834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.148995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.235759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1255/2543] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:59.237369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.250479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bdbff-f5c9-4c47-9ad7-01b381b28ce3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.253526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7bbc-3aaf-4140-8c46-2c479b619c62 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.260625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.260809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.261318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.261580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.261706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.261885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.261994 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.262163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.262779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:21:59.262959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.263121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.264743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.264863 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.283590 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1256/2544] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:21:59.284601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.284766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1289/2545] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:59.286205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.300623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195149-c387-4c5f-b76d-7a9e84f2eed0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.305641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30688e1-6f48-404e-8481-86b643de6e9d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.307850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.310206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.310502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.310887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] PATH_INFO: `/v3/projects/e5d342da8afe425ba4478130414b5b3b/users/fb5ffe99569d4ae9a9f225bd2b6670f1/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.313438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d342da8afe425ba4478130414b5b3b, user_id=fb5ffe99569d4ae9a9f225bd2b6670f1, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.313573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.314306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.315008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.315405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.316175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.316420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed8ef0-f93f-46a3-8251-12e126c25eb5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.318640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efff135-1074-4e56-825c-2d8b049af86c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.341438 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1290/2546] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:59 2022] PUT /identity/v3/projects/e5d342da8afe425ba4478130414b5b3b/users/fb5ffe99569d4ae9a9f225bd2b6670f1/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:59.344110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.344801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.344801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.358873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1257/2547] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:59.360658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.361149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.361437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.368822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] MFA Rules not processed for user `c2aa9f2c386647998cff8688be616660`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:59.370281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.393742 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] MFA Rules not processed for user `fb5ffe99569d4ae9a9f225bd2b6670f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:59.395090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.409064 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:59.432355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1291/2548] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:59.432355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.499984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1258/2549] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:21:59.514532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.521004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.521620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716aa9-b178-4046-83d1-1e56506744b8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.529549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.530240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.530526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.530865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.531656 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.535684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.584056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1292/2550] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:21:59.591231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:21:59.600167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.613394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98504b5-2766-4e1e-b9bc-808f4461c27a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.619926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.621160 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.621953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.621953 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.622184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e9d3-77dc-4d59-861c-714349e4c9ba admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.628940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.630105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.630616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.631094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.632844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.635800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.643522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.647640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1293/2551] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:59.649316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.651633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.665833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7d7fc-186a-4e8e-abd8-0d04326a5d82 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.670270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1259/2552] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:21:59.672366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.673128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.673495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.673786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.674522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.676236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.693364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1294/2553] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:21:59.697704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.714392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb8ab-302d-4b17-a2fd-e3306a1f1be2 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.721339 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.722943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.723458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.724186 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] PATH_INFO: `/v3/projects/78348c923568494e8b765643bbc31aa8/users/25851ddda4564d1da703de543ce05b11/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.749557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78348c923568494e8b765643bbc31aa8, user_id=25851ddda4564d1da703de543ce05b11, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:21:59.757520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7387fc-dfad-44fc-9f94-edb021c95371 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:21:59.766521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.776149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1260/2554] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:21:59 2022] PUT /identity/v3/projects/78348c923568494e8b765643bbc31aa8/users/25851ddda4564d1da703de543ce05b11/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:21:59.778396 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f45a-7292-4cac-91f0-b1bb03ead6d4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:21:59.787306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.787901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.789070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.823962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] MFA Rules not processed for user `25851ddda4564d1da703de543ce05b11`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:21:59.825974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.918886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:21:59.919563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:21:59.919852 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:21:59.920135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:21:59.923859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:21:59.936345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1261/2555] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:21:59.937529 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:21:59.940915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:00.011813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.014431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.017395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166ad8a-d3a6-4e57-a0c1-4b714d13c355 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.024444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.025185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.025539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.025888 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.027915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:00.039182 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1295/2556] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:00.040226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.049909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.051858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.054901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:00.067996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1262/2557] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:00.152590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ffe5-e773-4757-9582-7a5b3ab94898 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.158884 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.159949 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.160667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.161221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.162188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.165482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.212395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1296/2558] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:00 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:00.220453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.236522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18fe7c-4248-41e0-9c37-c46835651f04 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.364024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:00.382681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.383304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.383720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.384000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.384747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.386871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.412231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1263/2559] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:00 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:00.414799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.428407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868d28-d187-4b55-a75a-0226afce5104 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.434783 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.435978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.436798 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.437275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.438217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.440183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.453283 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1297/2560] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:00.457510 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.468134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352b1d8-b70a-478f-a835-fffd583c9e09 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.472867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.473775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.474061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.474341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] PATH_INFO: `/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0/users/2c2bd2c23a194f78bafbc73dc9c4901f/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.493013 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0703d5e7ed468081d6c5583a1c9ea0, user_id=2c2bd2c23a194f78bafbc73dc9c4901f, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.495766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.511226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1264/2561] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:00 2022] PUT /identity/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0/users/2c2bd2c23a194f78bafbc73dc9c4901f/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:00.515401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.525996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ac9a-d98f-4434-83ab-f99be9af5403 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.587167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.588175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.588668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.589133 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.589859 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.591452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c70f-f664-4e73-bc17-e5fe659c5785 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.606233 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1298/2562] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:00.608548 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.621902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28b96e-8c7d-4f60-8ddf-4dc06c60b0b6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.627541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.628479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.628794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.629077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] PATH_INFO: `/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0/users/2c2bd2c23a194f78bafbc73dc9c4901f/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.631348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0703d5e7ed468081d6c5583a1c9ea0, user_id=2c2bd2c23a194f78bafbc73dc9c4901f, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:00.634439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:00.661184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1265/2563] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:00 2022] PUT /identity/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0/users/2c2bd2c23a194f78bafbc73dc9c4901f/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:00.663643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.663936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.664255 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:00.705244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] MFA Rules not processed for user `2c2bd2c23a194f78bafbc73dc9c4901f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:00.706543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:00.799525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1299/2564] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:00.812787 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:00.815187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:00.943487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f98d-ac30-4310-8d86-76106bce9157 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:00.947639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:00.948321 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:00.948612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:00.948887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:01.034905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:01.036424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:01.049726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1266/2565] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:02.535889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:02.537388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:02.543711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:02.611139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63832235-b6da-42be-a52e-a060e162ebcd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:02.616696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:02.617363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:02.617650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:02.617935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:02.619826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:02.634981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:02.637071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:02.647967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1300/2566] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:06.927857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:06.937127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e34b0-99c9-46c3-8910-fffe2324e916 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:06.940827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:06.941463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:06.941746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:06.942020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:06.951724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:06.953192 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9935-51af-46ff-9d8c-b7a825d2380d service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:06.962952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1267/2567] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:12.644678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:13.405149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:13.406813 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:13.503005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f98374-3699-42d5-92ef-417eef71febe service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:13.508878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:13.509861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:13.511457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:13.511845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] PATH_INFO: `/v3/users/10219d18fe1746e89396203e3f961e6a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:13.513313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10219d18fe1746e89396203e3f961e6a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:13.515873 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:13.597106 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10219d18fe1746e89396203e3f961e6a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:13.597689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10219d18fe1746e89396203e3f961e6a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:13.606262 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10219d18fe1746e89396203e3f961e6a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:13.621476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10219d18fe1746e89396203e3f961e6a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:13.639229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10219d18fe1746e89396203e3f961e6a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:13.656028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1301/2568] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:13 2022] DELETE /identity/v3/users/10219d18fe1746e89396203e3f961e6a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:13.659976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:13.660511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:13.660614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:13.683294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:13.685550 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:13.750747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:13.792234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1268/2569] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:13.808464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:13.810224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:13.942327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01ae21-2ba6-4bdd-8ed1-400fc1f8f440 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:13.946901 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:13.947690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:13.947983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:13.948292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:13.962645 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:13.964143 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:13.979528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1302/2570] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:14.253791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:14.255425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:14.272481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc257a94-862d-4698-8d43-c4b49b2fab2e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:14.277709 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:14.278500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:14.278856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:14.279083 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] PATH_INFO: `/v3/projects/679e4bb7d928493a84a1543d8110a179` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:14.280309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=679e4bb7d928493a84a1543d8110a179)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:14.282261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:14.328091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679e4bb7d928493a84a1543d8110a179', 'request_id': 'req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:14.333804 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679e4bb7d928493a84a1543d8110a179', 'request_id': 'req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:14.341549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679e4bb7d928493a84a1543d8110a179', 'request_id': 'req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:14.353383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] The token cache is being invalidate because project 679e4bb7d928493a84a1543d8110a179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:14.353674 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:14.354306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:14.355831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1269/2571] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:14 2022] DELETE /identity/v3/projects/679e4bb7d928493a84a1543d8110a179 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:20.880805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:20.882314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:20.910975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:20.970033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa588-03d1-49b9-a74d-790780a622fa service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:21.035202 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:21.035857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:21.036141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:21.036447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:21.038313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:21.050924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:21.052557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b840a-9e15-4288-8909-f3e3430c4a9d service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:21.062966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1303/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:24.349630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:31.058592 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=52 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:37.050734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:37.052158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:37.116034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccea8a-4931-4fd0-a1a3-8568de6391ce admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:37.120729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:37.121599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:37.121889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:37.122171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] PATH_INFO: `/v3/users/25851ddda4564d1da703de543ce05b11` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:37.123362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25851ddda4564d1da703de543ce05b11)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:37.125368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:37.171356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25851ddda4564d1da703de543ce05b11'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.183243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25851ddda4564d1da703de543ce05b11'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.190443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25851ddda4564d1da703de543ce05b11'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.198092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25851ddda4564d1da703de543ce05b11'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.198755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25851ddda4564d1da703de543ce05b11'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.204693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1270/2573] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:37 2022] DELETE /identity/v3/users/25851ddda4564d1da703de543ce05b11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:37.209507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:37.209999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:37.210121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:37.227376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:37.228629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:37.285447 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1304/2574] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:37.295080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:37.296642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:37.353955 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdf342-5348-4c7a-a9eb-4aac918bb297 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:37.357594 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:37.358232 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:37.358515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:37.358793 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:37.367670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:37.369114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:37.378803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1271/2575] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:37.645842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:37.647338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:37.661174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beea8e-a75f-44cd-8072-c567c3243bcd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:37.682151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:37.683117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:37.683424 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:37.683751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] PATH_INFO: `/v3/projects/78348c923568494e8b765643bbc31aa8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:37.685121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78348c923568494e8b765643bbc31aa8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:37.687040 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:37.749097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78348c923568494e8b765643bbc31aa8', 'request_id': 'req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.757209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78348c923568494e8b765643bbc31aa8', 'request_id': 'req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.763509 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78348c923568494e8b765643bbc31aa8', 'request_id': 'req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.774971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] The token cache is being invalidate because project 78348c923568494e8b765643bbc31aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:37.775268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.775900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.777539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1305/2576] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:37 2022] DELETE /identity/v3/projects/78348c923568494e8b765643bbc31aa8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:37.781781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:37.792391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c260a5-d8c8-4493-a0c4-c937a52822de service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:37.811564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:37.862064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:37.862946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:37.863237 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:37.863521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] PATH_INFO: `/v3/users/2c2bd2c23a194f78bafbc73dc9c4901f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:37.864748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2bd2c23a194f78bafbc73dc9c4901f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:37.867578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:37.919464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2bd2c23a194f78bafbc73dc9c4901f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.932020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2bd2c23a194f78bafbc73dc9c4901f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.939471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2bd2c23a194f78bafbc73dc9c4901f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.947132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2bd2c23a194f78bafbc73dc9c4901f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.947869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a6f17f2c-07f9-4f2d-9838-560a4297735b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2bd2c23a194f78bafbc73dc9c4901f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:37.954349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1272/2577] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:37 2022] DELETE /identity/v3/users/2c2bd2c23a194f78bafbc73dc9c4901f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:38.242323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.244650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:38.261590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a9087-2d8b-4b5c-a66e-c720cb8fd22b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.323678 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.324616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.324904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.325184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] PATH_INFO: `/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.326510 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0703d5e7ed468081d6c5583a1c9ea0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.328870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.359677 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:38.376989 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0703d5e7ed468081d6c5583a1c9ea0', 'request_id': 'req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:38.384684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0703d5e7ed468081d6c5583a1c9ea0', 'request_id': 'req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:38.390693 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0703d5e7ed468081d6c5583a1c9ea0', 'request_id': 'req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:38.402789 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] The token cache is being invalidate because project 5a0703d5e7ed468081d6c5583a1c9ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:38.403082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:38.403722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5af18d62-ad32-49f6-91fd-10d34dbcf6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:38.405488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1306/2578] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:38 2022] DELETE /identity/v3/projects/5a0703d5e7ed468081d6c5583a1c9ea0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:38.410419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.410900 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.411005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.429065 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:38.430745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:38.502558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1273/2579] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:38.504241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.504552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.504840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.523988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:38.525243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:38.534971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1307/2580] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:38.539653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.550208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf535-ad82-445c-8ef2-e5e1b0acc26a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.556215 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.556890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.557180 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.557462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.558227 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:38.558537 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.560150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.571832 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1274/2581] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:22:38.576059 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.586034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e87f-e98a-4b38-8e9a-67be40dfe14e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.590609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.591284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.591567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.591843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.592559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.594457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.620051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1308/2582] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:38.624091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.634433 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcde-a5ee-47e1-8cbe-513d33de1e53 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.660001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:38.692372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.693043 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.693331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.693611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.694295 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.696763 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.716500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1275/2583] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:38.720574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.731244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8c831-e225-450f-98f8-f609bcfe6d8d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.735800 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.736500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.736785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.737061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.737781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.739373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.749557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1309/2584] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:38.753334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.763734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a163fa-d5e0-4483-b13a-1add5073727d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.768422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.769080 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.769396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.769680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.770414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.772016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d410ca-3621-4400-b6bf-d63b0b152201 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.782586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1276/2585] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:38.786577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:38.796908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcdacc-a430-4a49-ad13-81601a2acf80 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:38.801492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:38.802364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.802650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.802930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] PATH_INFO: `/v3/projects/f630764aa5f44b8abf92b0894a17ccde/users/cb2a432630a04974bd2e3a1ca4703c80/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.817190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f630764aa5f44b8abf92b0894a17ccde, user_id=cb2a432630a04974bd2e3a1ca4703c80, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:38.820382 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:38.833733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1310/2586] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:38 2022] PUT /identity/v3/projects/f630764aa5f44b8abf92b0894a17ccde/users/cb2a432630a04974bd2e3a1ca4703c80/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:38.844618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:38.844922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:38.845212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:38.871035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] MFA Rules not processed for user `cb2a432630a04974bd2e3a1ca4703c80`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:38.872174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:38.936165 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1277/2587] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:38.940675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.002136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565203b8-5502-4d82-a537-320ff3f60cb5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.007071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.008411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.008703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.008990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.009694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.011604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.036115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1311/2588] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:38 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:39.040159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.052018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8ead-5b12-4dbb-852f-9b8cc2d7936c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.112589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.113261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.113546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.113824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.114512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.116443 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.141890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1278/2589] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:39 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:39.143113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.153781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59c8c-d91b-4516-893c-d208d96b4bc5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.158427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.159083 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.159376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.160110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.160506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.162459 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.175847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1312/2590] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:39.180584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.191203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23a71e-d662-48c2-9ee4-6ecec7603ea0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.196695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.197613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.197904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.198190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] PATH_INFO: `/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b/users/5be16f4083524db3a6149f5c0bd0a9cf/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.218623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a5b4e7f9cd4f3cbe9a45fb878b7f3b, user_id=5be16f4083524db3a6149f5c0bd0a9cf, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.221453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.235648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1279/2591] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:39 2022] PUT /identity/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b/users/5be16f4083524db3a6149f5c0bd0a9cf/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:39.239806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.249634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55ff83-c3de-489a-a9d8-0fd0b0dbb6b0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.272306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:39.320679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.321488 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.321906 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.322252 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.323180 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.325467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93881a-0bed-4332-9e9b-84e5913b39fb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.343596 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1313/2592] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:39.347564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.353134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:39.359572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96f02-c0dc-431e-9260-d2690c45aea8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.364509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.365445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.365719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.365997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] PATH_INFO: `/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b/users/5be16f4083524db3a6149f5c0bd0a9cf/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.368666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a5b4e7f9cd4f3cbe9a45fb878b7f3b, user_id=5be16f4083524db3a6149f5c0bd0a9cf, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.371301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.382872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1280/2593] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:39 2022] PUT /identity/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b/users/5be16f4083524db3a6149f5c0bd0a9cf/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:39.393955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.394273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.394559 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.421079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] MFA Rules not processed for user `5be16f4083524db3a6149f5c0bd0a9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:39.422292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:39.488988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1314/2594] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:39.500166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.501985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:39.559023 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df4b5-2235-4c7c-aa67-700ff6b3e9f2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.562714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.563351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.563636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.563911 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.573451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.574884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ee18-353d-4249-a06f-1212fb670b54 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.587184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1281/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:39.652247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.715362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07f3d9-774d-4a09-ac1b-d35796691d55 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.719970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.720867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.721153 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.721429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] PATH_INFO: `/v3/users/cb2a432630a04974bd2e3a1ca4703c80` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.722622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2a432630a04974bd2e3a1ca4703c80)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.724589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.771684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2a432630a04974bd2e3a1ca4703c80'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:39.772364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2a432630a04974bd2e3a1ca4703c80'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:39.774080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:39.781445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2a432630a04974bd2e3a1ca4703c80'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:39.793830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2a432630a04974bd2e3a1ca4703c80'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:39.801090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2a432630a04974bd2e3a1ca4703c80'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:39.807101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1315/2596] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:39 2022] DELETE /identity/v3/users/cb2a432630a04974bd2e3a1ca4703c80 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:39.811838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.812282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.812692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.831000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:39.832217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:39.900314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1282/2597] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:39.910321 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:39.911769 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:39.970731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c1f3e-acf6-4046-81c8-10bf66b4d0f8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:39.974766 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:39.975414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:39.975700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:39.975999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:39.985808 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:39.987506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:39.997008 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1316/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:40.257829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:40.259297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:40.274162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed0d33-a890-4516-8f2f-f36980c75678 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:40.279093 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:40.279960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:40.280279 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:40.280557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] PATH_INFO: `/v3/projects/f630764aa5f44b8abf92b0894a17ccde` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:40.281841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f630764aa5f44b8abf92b0894a17ccde)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:40.283683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:40.329734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f630764aa5f44b8abf92b0894a17ccde', 'request_id': 'req-6e7731cb-8c20-4043-85b8-67129a3925ff'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.336450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f630764aa5f44b8abf92b0894a17ccde', 'request_id': 'req-6e7731cb-8c20-4043-85b8-67129a3925ff'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.344688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f630764aa5f44b8abf92b0894a17ccde', 'request_id': 'req-6e7731cb-8c20-4043-85b8-67129a3925ff'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.356390 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] The token cache is being invalidate because project f630764aa5f44b8abf92b0894a17ccde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:40.356770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.357440 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.358988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1283/2599] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:40 2022] DELETE /identity/v3/projects/f630764aa5f44b8abf92b0894a17ccde => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:40.362968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:40.372865 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eaf95-9075-4d73-b134-bb5336b38548 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:40.432936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:40.433785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:40.434071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:40.434351 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] PATH_INFO: `/v3/users/5be16f4083524db3a6149f5c0bd0a9cf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:40.435634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be16f4083524db3a6149f5c0bd0a9cf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:40.437709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:40.485722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be16f4083524db3a6149f5c0bd0a9cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.486412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be16f4083524db3a6149f5c0bd0a9cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.494369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be16f4083524db3a6149f5c0bd0a9cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.504945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:40.508301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be16f4083524db3a6149f5c0bd0a9cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.518589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-fcbcc9e4-5e78-48ed-be5e-6a17f4c3622c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be16f4083524db3a6149f5c0bd0a9cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.526288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1317/2600] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:40 2022] DELETE /identity/v3/users/5be16f4083524db3a6149f5c0bd0a9cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:40.837862 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:40.839396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:40.854810 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7731cb-8c20-4043-85b8-67129a3925ff admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:40.867866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:40.916179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:40.917081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:40.917361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:40.917643 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] PATH_INFO: `/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:40.919113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a5b4e7f9cd4f3cbe9a45fb878b7f3b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:40.921095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:40.967918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a5b4e7f9cd4f3cbe9a45fb878b7f3b', 'request_id': 'req-fdcfa82c-fa05-4b53-aa27-799c4062e69c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.973283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a5b4e7f9cd4f3cbe9a45fb878b7f3b', 'request_id': 'req-fdcfa82c-fa05-4b53-aa27-799c4062e69c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.980200 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a5b4e7f9cd4f3cbe9a45fb878b7f3b', 'request_id': 'req-fdcfa82c-fa05-4b53-aa27-799c4062e69c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.991980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] The token cache is being invalidate because project 81a5b4e7f9cd4f3cbe9a45fb878b7f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:40.992304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.992943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fdcfa82c-fa05-4b53-aa27-799c4062e69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:40.994479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1284/2601] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:40 2022] DELETE /identity/v3/projects/81a5b4e7f9cd4f3cbe9a45fb878b7f3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:40.999576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:40.999878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.000208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.018561 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:41.019814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:41.079303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1318/2602] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:41.087922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.088240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.088551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.106317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:41.107511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:41.115766 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1285/2603] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:41.119874 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.129760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefd7e0-28d5-462e-97ed-872990631553 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.134857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.135511 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.135802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.136082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.136844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:41.137157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.138868 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.150959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1319/2604] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:22:41.155128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.164457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d577d9-a061-4893-b82a-b5e16047c5b8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.169470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.170122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.170412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.170694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.171386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.173367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.200282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1286/2605] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:41.204119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.214881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4b5b-64f5-47a0-80d2-0c1f8f9b8c3c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.272014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.272651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.273454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.273740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.274443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.276403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.295981 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1320/2606] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:41.300146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.310506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34426e6-16d5-4c25-969e-8db1baf818ce admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.315105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.315764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.316049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.316364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.317095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.318694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.329103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1287/2607] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:41.333271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.343747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428a96-86ca-424b-a887-61b259849abb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.348384 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.349037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.349330 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.349615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.350344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.352641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650611d-02c7-42b0-a5f2-0bcdfd0a7f87 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.362465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1321/2608] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:41.366317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.376354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626344-333a-46cf-9515-2b3788a721da admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.381017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.381945 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.382238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.382547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] PATH_INFO: `/v3/projects/3ba824fb636540b1a6011f8569bf4da0/users/b283a449a84941b7b3e45d01e56f4332/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.397163 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba824fb636540b1a6011f8569bf4da0, user_id=b283a449a84941b7b3e45d01e56f4332, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.400348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.413109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1288/2609] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:41 2022] PUT /identity/v3/projects/3ba824fb636540b1a6011f8569bf4da0/users/b283a449a84941b7b3e45d01e56f4332/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:41.423965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.424484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.424604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.450452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] MFA Rules not processed for user `b283a449a84941b7b3e45d01e56f4332`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:41.451659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:41.492965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:41.517987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1322/2610] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:41.522698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.567311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:41.590330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158baf00-d087-47fc-a893-b9eb2dce967c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.595004 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.595664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.595954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.596260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.596962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.598866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.623058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1289/2611] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:41.627192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.638633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b5fc7-13b4-42a9-b48b-7de06771fa1b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.694140 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.695297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.695582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.695860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.696600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.698518 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.718228 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1323/2612] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:41 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:41.722369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.732660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787aa89-123a-4587-bafe-eccb6fdee91d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.737351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.738020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.738308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.738592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.739568 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.740976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.754532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1290/2613] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:41.755641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.766369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ae3b-c2aa-4cad-8215-641d2736e81f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.771170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.772057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.772399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.772664 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] PATH_INFO: `/v3/projects/7c7391373d0e46789522d6d54e82d675/users/66f67d397a234111a8dd32410cf262fe/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.790229 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7391373d0e46789522d6d54e82d675, user_id=66f67d397a234111a8dd32410cf262fe, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.793081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.806128 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1324/2614] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:41 2022] PUT /identity/v3/projects/7c7391373d0e46789522d6d54e82d675/users/66f67d397a234111a8dd32410cf262fe/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:41.810915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.821841 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8b9c6-85f0-4151-bc80-d1c10831fe0f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.880775 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.881530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.881818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.882102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.883338 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.884979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afc532-ef3e-43cc-8012-97e6dc2fc8ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.895788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1291/2615] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:41.900587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:41.913810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69579fc9-ff56-41a3-bcf3-9b3622b72b4c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:41.918992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:41.919904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:41.920346 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:41.920632 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] PATH_INFO: `/v3/projects/7c7391373d0e46789522d6d54e82d675/users/66f67d397a234111a8dd32410cf262fe/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:41.922753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7391373d0e46789522d6d54e82d675, user_id=66f67d397a234111a8dd32410cf262fe, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:41.925706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:41.937805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1325/2616] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:41 2022] PUT /identity/v3/projects/7c7391373d0e46789522d6d54e82d675/users/66f67d397a234111a8dd32410cf262fe/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:42.011596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:42.011889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:42.012168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:42.037819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] MFA Rules not processed for user `66f67d397a234111a8dd32410cf262fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:42.038957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:42.106768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1292/2617] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:42.118638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:42.120400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:42.176558 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f7453-11e0-41a3-9e06-bce17e073fe5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:42.180882 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:42.181531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:42.181816 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:42.182095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:42.191703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:42.193170 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:42.203201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1326/2618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:42.282169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:42.291914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38e6b-6c96-40b3-b2db-d22d180d3c0f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:42.295759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:42.296446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:42.296737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:42.297016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:42.330521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:42.355448 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:42.356920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:42.365651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1293/2619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:49.119658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.121172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.134484 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.166820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:49.191025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825109b-7fee-487c-bf0d-e660b6060dfb service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.196103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.197016 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.197303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.197583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] PATH_INFO: `/v3/users/775c06d25c724f4d9839c7e87e67f483` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.197987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23419-4890-4d04-9186-af2eb2d02ee8 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.198760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775c06d25c724f4d9839c7e87e67f483)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.200774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.202960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.203855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.204142 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.204455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] PATH_INFO: `/v3/users/b283a449a84941b7b3e45d01e56f4332` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.206450 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b283a449a84941b7b3e45d01e56f4332)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.208680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.250551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775c06d25c724f4d9839c7e87e67f483'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.251304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775c06d25c724f4d9839c7e87e67f483'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.258037 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b283a449a84941b7b3e45d01e56f4332'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.259240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775c06d25c724f4d9839c7e87e67f483'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.270053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b283a449a84941b7b3e45d01e56f4332'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.271674 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775c06d25c724f4d9839c7e87e67f483'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.279082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b283a449a84941b7b3e45d01e56f4332'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.279975 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f0b80361-7660-44e9-bcb0-62146ba8d025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775c06d25c724f4d9839c7e87e67f483'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.286423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1327/2620] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/users/775c06d25c724f4d9839c7e87e67f483 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:49.287105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b283a449a84941b7b3e45d01e56f4332'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.287929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0acf4e2a-b0e4-46f1-949e-3f08c2de8ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b283a449a84941b7b3e45d01e56f4332'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.291543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.291936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.292339 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.294357 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1294/2621] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/users/b283a449a84941b7b3e45d01e56f4332 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:49.298791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.299092 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.299372 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.310686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:49.312011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.317008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:49.318236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.366376 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:49.375204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1328/2622] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:49.379620 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1295/2623] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:49.385322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.386756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.389449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.390736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.445243 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f553e8-3225-4581-b15e-2d58e0dce88f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.448248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a0ad-06d5-4a77-8a73-203be9e3cde1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.448983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.449638 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.449928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.450209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.451831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.452503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.452788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.453063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.460235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.461686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.462203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.463637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.466691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:49.472441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1329/2624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:49.473637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1296/2625] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:22:49.772750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.774361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.786689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.788704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.792682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795632e4-e927-456e-88e0-0fc38a8965e6 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.799056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.800027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.800381 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.800699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] PATH_INFO: `/v3/projects/296ab440b5f84772bd8e82b5ea69e727` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.801953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296ab440b5f84772bd8e82b5ea69e727)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.804504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.805561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02de6-9c7c-48a7-b7da-30834692a97e service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.810672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.811612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.811964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.812348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] PATH_INFO: `/v3/projects/3ba824fb636540b1a6011f8569bf4da0` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.813734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba824fb636540b1a6011f8569bf4da0)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.815852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:49.857609 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296ab440b5f84772bd8e82b5ea69e727', 'request_id': 'req-f8ff6a49-704a-47e2-ae15-f97e960f1206'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.865794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296ab440b5f84772bd8e82b5ea69e727', 'request_id': 'req-f8ff6a49-704a-47e2-ae15-f97e960f1206'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.872119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296ab440b5f84772bd8e82b5ea69e727', 'request_id': 'req-f8ff6a49-704a-47e2-ae15-f97e960f1206'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.875910 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba824fb636540b1a6011f8569bf4da0', 'request_id': 'req-46389e9f-a181-4056-92fb-1a273df1707f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.881547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba824fb636540b1a6011f8569bf4da0', 'request_id': 'req-46389e9f-a181-4056-92fb-1a273df1707f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.884010 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] The token cache is being invalidate because project 296ab440b5f84772bd8e82b5ea69e727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:49.884451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.885443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.887743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1330/2626] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/projects/296ab440b5f84772bd8e82b5ea69e727 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:49.891691 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.891838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba824fb636540b1a6011f8569bf4da0', 'request_id': 'req-46389e9f-a181-4056-92fb-1a273df1707f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.893273 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.903760 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] The token cache is being invalidate because project 3ba824fb636540b1a6011f8569bf4da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:49.904057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.904743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:49.906285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1297/2627] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/projects/3ba824fb636540b1a6011f8569bf4da0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:49.910116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:49.911466 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:49.960943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6a49-704a-47e2-ae15-f97e960f1206 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.977987 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389e9f-a181-4056-92fb-1a273df1707f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:49.982778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:49.983653 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:49.983930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:49.984238 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] PATH_INFO: `/v3/users/66f67d397a234111a8dd32410cf262fe` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:49.985471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f67d397a234111a8dd32410cf262fe)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:49.987412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.010379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:50.028033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.029941 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.030463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.030955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] PATH_INFO: `/v3/users/fb5ffe99569d4ae9a9f225bd2b6670f1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.032667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5ffe99569d4ae9a9f225bd2b6670f1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.034620 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.037154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f67d397a234111a8dd32410cf262fe'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.050069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f67d397a234111a8dd32410cf262fe'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.058188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f67d397a234111a8dd32410cf262fe'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.066239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f67d397a234111a8dd32410cf262fe'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.067159 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f67d397a234111a8dd32410cf262fe'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.072019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:50.077164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1298/2628] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/users/66f67d397a234111a8dd32410cf262fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:50.087269 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5ffe99569d4ae9a9f225bd2b6670f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.087995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5ffe99569d4ae9a9f225bd2b6670f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.095271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5ffe99569d4ae9a9f225bd2b6670f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.111023 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5ffe99569d4ae9a9f225bd2b6670f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.121027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5ffe99569d4ae9a9f225bd2b6670f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.127762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1331/2629] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:49 2022] DELETE /identity/v3/users/fb5ffe99569d4ae9a9f225bd2b6670f1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:50.399765 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.401798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.434858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.436471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.484758 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c216fc-3ee4-4ae4-8587-019213e19d4a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.508745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779856-990e-4dea-87fb-c06973327882 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.513442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.514311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.514591 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.514863 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] PATH_INFO: `/v3/projects/e5d342da8afe425ba4478130414b5b3b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.516065 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d342da8afe425ba4478130414b5b3b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.518043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.547959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.548891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.549179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.549460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] PATH_INFO: `/v3/projects/7c7391373d0e46789522d6d54e82d675` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.550684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7391373d0e46789522d6d54e82d675)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.552676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.566740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d342da8afe425ba4478130414b5b3b', 'request_id': 'req-c1c609c7-0905-428d-b61d-90d98f05d427'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.575577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d342da8afe425ba4478130414b5b3b', 'request_id': 'req-c1c609c7-0905-428d-b61d-90d98f05d427'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.583329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d342da8afe425ba4478130414b5b3b', 'request_id': 'req-c1c609c7-0905-428d-b61d-90d98f05d427'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.596926 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] The token cache is being invalidate because project e5d342da8afe425ba4478130414b5b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:50.597214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.597909 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c1c609c7-0905-428d-b61d-90d98f05d427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.599697 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1332/2630] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:50 2022] DELETE /identity/v3/projects/e5d342da8afe425ba4478130414b5b3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:50.604630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2372a-7f12-4529-87cf-c8667e887f82 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.605003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2372a-7f12-4529-87cf-c8667e887f82 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.605134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7391373d0e46789522d6d54e82d675', 'request_id': 'req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.605406 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2372a-7f12-4529-87cf-c8667e887f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.606409 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:50.612540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7391373d0e46789522d6d54e82d675', 'request_id': 'req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.621150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7391373d0e46789522d6d54e82d675', 'request_id': 'req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.623758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dff2372a-7f12-4529-87cf-c8667e887f82 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:50.625205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dff2372a-7f12-4529-87cf-c8667e887f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.634199 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] The token cache is being invalidate because project 7c7391373d0e46789522d6d54e82d675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:50.634491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.635144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-daf34bb4-1c5a-49c5-87c6-21fc44e2791e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:50.636732 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1299/2631] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:50 2022] DELETE /identity/v3/projects/7c7391373d0e46789522d6d54e82d675 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:50.641646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e28ef-751c-412a-b9df-96f6b48b310c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.641983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e28ef-751c-412a-b9df-96f6b48b310c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.642265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e28ef-751c-412a-b9df-96f6b48b310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.662330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d55e28ef-751c-412a-b9df-96f6b48b310c None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:50.663564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d55e28ef-751c-412a-b9df-96f6b48b310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.666070 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:50.694500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1333/2632] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:50.702814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.703197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.703537 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.722315 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:50.723522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.724639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1300/2633] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:50.731912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1334/2634] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:50.732291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.732588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.732868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.735729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.744963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b679e-c756-415d-b8b6-36745bd10961 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.749611 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.750253 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.750547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.750830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.750960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:50.751555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:50.751866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.752091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:50.753530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.760452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1301/2635] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:50.764424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.769531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1335/2636] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:22:50.770584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.773967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567ce7c-c58c-46c9-8b53-a1a986930553 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.778575 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.779216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.779501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.779779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.780557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:50.780684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72540c-fcc8-4f8c-95d3-a98feaf49c3e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.780870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.782458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.785184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.785799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.786085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.786363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.787037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.789516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.794628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1302/2637] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:22:50.798768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.809488 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d81-1a61-4a14-90a6-c94769d1aa00 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.815667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.816358 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.816648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.816929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.817636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.817793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1336/2638] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:50.819666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.821931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.848296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1303/2639] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:50.850071 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.887555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb136f9-7fb8-42bf-82f4-2e76a17c65e1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.917094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cb846-de92-4f1a-977d-a00f344af017 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.921822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.922494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.922784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.923097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.923788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.925754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.945902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.949389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1304/2640] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:50.949545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.949545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.949545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.949545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.950020 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.950519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.961185 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c2988-740b-47c4-aad6-81cae84cec4f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.967397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.968906 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.969249 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.969536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.970297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.971824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1337/2641] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:50 2022] POST /identity/v3/users => generated 278 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:50.971965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:50.975684 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.985782 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1305/2642] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:50.986790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:50.988405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c331f0-a915-4859-904d-c69d5023d6c7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.993236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:50.993889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:50.994179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:50.994458 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:50.995178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:50.996487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844d3d-53f1-4b80-b76e-342e4e43c26a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:50.996918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.001203 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.001852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.002153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.002444 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.003393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.005301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.007748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1338/2643] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.011439 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.019753 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1306/2644] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.020752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.021587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e386733-5137-4e0f-afb3-c6b646f5b013 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.027104 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.027760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.028029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.028154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.028364 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.029089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.031235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.032140 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34bc8-efe1-4005-b76c-7aa7ab3e22b1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.039714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.040802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.041261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.041669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] PATH_INFO: `/v3/projects/da08433ec3e242588590ab8596d1be18/users/59063cd967f7446891347f284c389ae5/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.042973 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1339/2645] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.047004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.056455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd202-e5de-45ad-bcfd-5c70d90956ad admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.057075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da08433ec3e242588590ab8596d1be18, user_id=59063cd967f7446891347f284c389ae5, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.059729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe7368-d68f-4ad2-9b0c-cae13a23692a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.061108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.061965 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.062249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.062527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] PATH_INFO: `/v3/projects/0515169577b243ce999666570a048fd3/users/d708cf1a81544fb68a164b3265e61f48/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.073217 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1307/2646] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/da08433ec3e242588590ab8596d1be18/users/59063cd967f7446891347f284c389ae5/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:51.074329 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.079440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0515169577b243ce999666570a048fd3, user_id=d708cf1a81544fb68a164b3265e61f48, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.082247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d10a24-b025-418c-a856-42c4e80d8671 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.084813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.085664 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.085986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.096972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1340/2647] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/0515169577b243ce999666570a048fd3/users/d708cf1a81544fb68a164b3265e61f48/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:51.116752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] MFA Rules not processed for user `59063cd967f7446891347f284c389ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:51.118039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.159005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.159587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.159770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.186004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] MFA Rules not processed for user `d708cf1a81544fb68a164b3265e61f48`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:51.187046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1308/2648] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:51.187288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.191383 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.253853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1341/2649] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:51.257482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd68640-87ef-4efb-8c6c-5dd7e3ccf235 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.258847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.262482 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.263099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.263384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.263669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.264393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.266316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.269711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf154572-cdd5-4505-bb06-30726ce5ee12 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.275748 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.277136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.277436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.277733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.278539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.280512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.295511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1309/2650] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:51.296540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.309787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1342/2651] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:51.310780 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.355125 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.360974 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b2a9-76b6-4fcd-b978-3eac1011586a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.373418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a94b3-8bb6-4c77-a369-4e21b274d781 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.378094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.378778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.379091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.379484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.380183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.382625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.403998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1343/2652] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:51.408122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.418889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dff-e847-475d-b801-36e8c371fdb9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.423788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.424534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.424825 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.425108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.426041 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.427696 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.442014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1344/2653] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.443241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.454806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c990-19c6-4beb-83a8-5058d78587ce admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.461420 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.462369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.462690 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.462970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] PATH_INFO: `/v3/projects/9b5e63ab08894d328252eaf99b2357a0/users/7b399b2d7267408eb68b3beb47ce4c62/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.479502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5e63ab08894d328252eaf99b2357a0, user_id=7b399b2d7267408eb68b3beb47ce4c62, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.482574 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.499603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1345/2654] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/9b5e63ab08894d328252eaf99b2357a0/users/7b399b2d7267408eb68b3beb47ce4c62/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:51.504221 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.517585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.543258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.543952 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.544246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.544523 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.545350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.547315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.570311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1310/2655] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:51.571324 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.572258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500879bc-6161-4f60-a8e5-ba0f968f2b29 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.576966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.577603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.577889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.578171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.578903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.580673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.583166 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98ec66-c310-4408-996b-eb91054c4367 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.588501 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.589161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.589478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.589762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.590578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.591724 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1346/2656] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:51.592175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.595746 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.602512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1311/2657] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.605640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97b29-f884-4024-9b13-b23428e489ae admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.606885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.610378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.611257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.611540 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.611819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] PATH_INFO: `/v3/projects/9b5e63ab08894d328252eaf99b2357a0/users/7b399b2d7267408eb68b3beb47ce4c62/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.613869 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5e63ab08894d328252eaf99b2357a0, user_id=7b399b2d7267408eb68b3beb47ce4c62, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.616570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44069790-c312-478c-a236-4122bbd8ab2f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.616726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca66e-b3d8-42a5-8aed-84ce42af3720 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.621297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.622252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.622535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.622814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] PATH_INFO: `/v3/projects/5c46287982e8413db953e81128b685f1/users/e995849c049a40aabaf9ca998966d658/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.628003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1347/2658] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/9b5e63ab08894d328252eaf99b2357a0/users/7b399b2d7267408eb68b3beb47ce4c62/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:51.639733 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.640028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.640360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.643298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c46287982e8413db953e81128b685f1, user_id=e995849c049a40aabaf9ca998966d658, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.648736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.661991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1312/2659] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/5c46287982e8413db953e81128b685f1/users/e995849c049a40aabaf9ca998966d658/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:22:51.665831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.670015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] MFA Rules not processed for user `7b399b2d7267408eb68b3beb47ce4c62`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:51.671212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.730331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4d00-1a20-42fa-a9cc-d71a85646fe4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.735035 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.735699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.735988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.736299 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.737022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.738625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.744393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1348/2660] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:51.748570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1313/2661] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:22:51.752398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.755252 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.756927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.764953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad757fe-5ce2-4219-8e98-872de4531955 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.769551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.770433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.770716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.770999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] PATH_INFO: `/v3/projects/5c46287982e8413db953e81128b685f1/users/e995849c049a40aabaf9ca998966d658/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.773502 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c46287982e8413db953e81128b685f1, user_id=e995849c049a40aabaf9ca998966d658, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.776215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d6f6-9a98-40fd-abf3-579636b328ad admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.786417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1349/2662] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:51 2022] PUT /identity/v3/projects/5c46287982e8413db953e81128b685f1/users/e995849c049a40aabaf9ca998966d658/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:51.797183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.797476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.797759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.815875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1604-f44d-4dc6-87d6-c2a051e8e0e0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.820616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.827051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] MFA Rules not processed for user `e995849c049a40aabaf9ca998966d658`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:51.828313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.865982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.866647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.866929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.867212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.879565 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:51.899036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1350/2663] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:51.909775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:51.911142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:51.923562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076de6b-01c3-4235-a7d5-1c22463fcfc0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:51.927260 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:51.927897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:51.928184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:51.928490 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:51.928648 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.930030 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.937658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:51.939543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1314/2664] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:22:51.939755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:51.949931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1351/2665] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:22:52.024333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:52.033245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bf9d-bc53-4589-a703-17c0a92b7192 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:52.036921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:52.037559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:52.037845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:52.038148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:52.100915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:52.102364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0dc02-31e5-4eca-8ac0-31540d4ff4aa service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:52.111342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1315/2666] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:52.353344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:52.413971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0edbd-9d6b-4327-8035-712bc336b722 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:52.418483 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:52.419395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:52.419683 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:52.419957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] PATH_INFO: `/v3/users/59063cd967f7446891347f284c389ae5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:52.421166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59063cd967f7446891347f284c389ae5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:52.423076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:52.470281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59063cd967f7446891347f284c389ae5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:52.470924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59063cd967f7446891347f284c389ae5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:52.477888 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59063cd967f7446891347f284c389ae5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:52.490431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59063cd967f7446891347f284c389ae5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:52.498515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59063cd967f7446891347f284c389ae5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:52.504744 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1352/2667] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:52 2022] DELETE /identity/v3/users/59063cd967f7446891347f284c389ae5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:52.509877 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:52.510168 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:52.510451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:52.527405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:52.528635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:52.577803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:52.587821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1316/2668] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:52.597437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:52.598834 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:52.657651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10dbf1-6a2d-44a7-ad79-74556211df1e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:52.661344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:52.661999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:52.662285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:52.662563 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:52.671721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:52.673148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:52.678067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:52.684379 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1353/2669] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:52.947609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:52.949110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:52.962061 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b74054-4875-4039-bdaf-fea5926ce12e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:52.967563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:52.968462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:52.968755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:52.969087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] PATH_INFO: `/v3/projects/da08433ec3e242588590ab8596d1be18` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:52.970431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da08433ec3e242588590ab8596d1be18)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:52.972473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.019844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da08433ec3e242588590ab8596d1be18', 'request_id': 'req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.026235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da08433ec3e242588590ab8596d1be18', 'request_id': 'req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.033343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da08433ec3e242588590ab8596d1be18', 'request_id': 'req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.045182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] The token cache is being invalidate because project da08433ec3e242588590ab8596d1be18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:53.045470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.046095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.047645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1317/2670] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:52 2022] DELETE /identity/v3/projects/da08433ec3e242588590ab8596d1be18 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:53.051658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.061407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f53fc-2833-448a-8461-c35f43d31190 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.120448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.121323 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.121615 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.121899 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] PATH_INFO: `/v3/users/e995849c049a40aabaf9ca998966d658` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.123086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e995849c049a40aabaf9ca998966d658)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.125057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.171570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e995849c049a40aabaf9ca998966d658'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.172239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e995849c049a40aabaf9ca998966d658'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.179732 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e995849c049a40aabaf9ca998966d658'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.191765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e995849c049a40aabaf9ca998966d658'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.199507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-043dfed9-fb93-4c5c-99f6-c2fe9253a545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e995849c049a40aabaf9ca998966d658'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.205626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1354/2671] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:53 2022] DELETE /identity/v3/users/e995849c049a40aabaf9ca998966d658 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:53.494407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.496225 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:53.510175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306f7b4-4f65-4d15-87ec-41db0b0d8b19 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.565436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.566302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.566588 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.566867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] PATH_INFO: `/v3/projects/5c46287982e8413db953e81128b685f1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.568039 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c46287982e8413db953e81128b685f1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.570561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.617245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c46287982e8413db953e81128b685f1', 'request_id': 'req-77b9de11-683e-454e-9003-eadffff44d93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.623077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c46287982e8413db953e81128b685f1', 'request_id': 'req-77b9de11-683e-454e-9003-eadffff44d93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.630391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c46287982e8413db953e81128b685f1', 'request_id': 'req-77b9de11-683e-454e-9003-eadffff44d93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.642260 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] The token cache is being invalidate because project 5c46287982e8413db953e81128b685f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:53.642551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.643194 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77b9de11-683e-454e-9003-eadffff44d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:53.644750 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1318/2672] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:53 2022] DELETE /identity/v3/projects/5c46287982e8413db953e81128b685f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:53.651199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.651676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.651778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.670158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:53.671372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:53.730485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1355/2673] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:53.738456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.738749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.739027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.757275 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:53.758470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:53.766207 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1319/2674] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:53.770369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.782282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c45a-b7b5-4555-a78b-2e4cbdfd109a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.786977 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.787626 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.787915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.788214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.788942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:53.789249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.790871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.802431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1356/2675] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:22:53.806707 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.812271 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:53.816481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc12b-a4e0-4272-82ea-45148f39a27a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.823007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.823858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.824382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.824773 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.825713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.827610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.852809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1320/2676] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:53 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:53.856883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.866843 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a18a6-dd23-4d31-97a4-fc0b3b22383e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.870325 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:53.925411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.926077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.926365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.926649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.927342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.929828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.950194 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1357/2677] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:53 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:53.954398 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.965063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d637e-420f-44b5-afc7-4f0a842e069a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:53.969856 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:53.970509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:53.970798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:53.971075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:53.971799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:53.973441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:53.984158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1321/2678] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:53.987922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:53.998575 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfbe14-4747-4281-a4d8-f01346ab26f4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.003377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.004067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.004387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.004667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.005391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.007623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fc5e3-0532-4d3d-acdb-025a916c1075 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:54.017549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1358/2679] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:54.021494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:54.031311 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917096a-ac7a-407b-9ee6-5a3e35ed8428 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.035850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.036737 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.037021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.037296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] PATH_INFO: `/v3/projects/6ecc3c9cc6384e968f1cd4eb43ccef5f/users/075585f67799422b8b1b622ad8a5c387/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.051355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecc3c9cc6384e968f1cd4eb43ccef5f, user_id=075585f67799422b8b1b622ad8a5c387, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.054514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:54.067270 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1322/2680] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:54 2022] PUT /identity/v3/projects/6ecc3c9cc6384e968f1cd4eb43ccef5f/users/075585f67799422b8b1b622ad8a5c387/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:54.079527 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.079858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.080148 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.106642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] MFA Rules not processed for user `075585f67799422b8b1b622ad8a5c387`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:54.107871 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:54.171057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1359/2681] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:54.202360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:54.204082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:54.260867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086984-f152-4971-952f-3239d9766992 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.264699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.265346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.265637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.265922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.274838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.276304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15a20-bc71-4e03-9dca-ece300b71eae service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:54.284997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1323/2682] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:22:54.299279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:54.362928 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6f711-716f-489a-9eb0-bcafab487172 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.367838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.368787 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.369099 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.369403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] PATH_INFO: `/v3/users/075585f67799422b8b1b622ad8a5c387` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.370673 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=075585f67799422b8b1b622ad8a5c387)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.372757 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:54.390436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:54.423342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075585f67799422b8b1b622ad8a5c387'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:54.424019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075585f67799422b8b1b622ad8a5c387'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:54.431161 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075585f67799422b8b1b622ad8a5c387'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:54.443334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075585f67799422b8b1b622ad8a5c387'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:54.452403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075585f67799422b8b1b622ad8a5c387'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:54.458604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1360/2683] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:22:54 2022] DELETE /identity/v3/users/075585f67799422b8b1b622ad8a5c387 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:54.465895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.466187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.466463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.484844 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:54.486172 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:54.546870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1324/2684] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:54.557484 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:54.558894 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:54.621630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914ab5-b2d3-4d92-a674-641a34cd6f6f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.625358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.626009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.626297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.626577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.637335 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.638849 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b3312-0380-44c0-899c-1720f975b349 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:54.653333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1361/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:54.930645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:54.932776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:54.947480 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba971f-6577-4e6c-9187-d2734b157e63 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:54.952374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:54.953246 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:54.953535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:54.953818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] PATH_INFO: `/v3/projects/6ecc3c9cc6384e968f1cd4eb43ccef5f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:54.955145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ecc3c9cc6384e968f1cd4eb43ccef5f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:54.957146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.001449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:55.005146 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ecc3c9cc6384e968f1cd4eb43ccef5f', 'request_id': 'req-808bc553-3986-4b95-9201-c4f89a025647'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:55.012345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ecc3c9cc6384e968f1cd4eb43ccef5f', 'request_id': 'req-808bc553-3986-4b95-9201-c4f89a025647'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:55.019993 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ecc3c9cc6384e968f1cd4eb43ccef5f', 'request_id': 'req-808bc553-3986-4b95-9201-c4f89a025647'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:55.031491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] The token cache is being invalidate because project 6ecc3c9cc6384e968f1cd4eb43ccef5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:22:55.031776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:55.032425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-808bc553-3986-4b95-9201-c4f89a025647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:22:55.033971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1325/2686] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:22:54 2022] DELETE /identity/v3/projects/6ecc3c9cc6384e968f1cd4eb43ccef5f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:55.039012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.039316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.039614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.056850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:55.058087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:55.119587 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1362/2687] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:55.127386 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.127688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.127976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.146264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:55.148171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:55.156145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1326/2688] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:55.160296 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.170005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317ea82-6424-4e93-8bc4-43fbffe988cc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.174855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.175508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.175797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.176080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.176853 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:22:55.177165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.178779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.190212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1363/2689] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:22:55.195137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.204797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e6ce-b7ab-42e7-98ef-31eb1122a1da None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.210551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.211248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.211544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.211842 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.212619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.214651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.240511 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1327/2690] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:55 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:55.244861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.254794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae1df-9c4c-4253-a5e9-2165b8276632 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.275619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:22:55.315001 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.315731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.316086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.316411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.317116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.319703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.340524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1364/2691] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:55 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:22:55.344823 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.354938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695fce-e11f-49d3-bae5-46e886f376b8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.359530 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.360209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.360505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.360785 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.361515 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.363104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.374235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1328/2692] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:55.378392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.388964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30b60-32fb-478e-a4a4-503cf6ca528b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.393562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.394214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.394503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.394784 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.395517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.397141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c50f-c9ec-4d35-bfc6-49744e817b0f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.407570 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1365/2693] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:22:55.411801 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.421651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70c47-9bf7-492f-a9dc-7583a170b6ec admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.426101 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.426964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.427240 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.427516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] PATH_INFO: `/v3/projects/97a2d5a2afb34be58295ddc1586e9a31/users/d58cfae576584be28b93f15976a411af/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.442791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a2d5a2afb34be58295ddc1586e9a31, user_id=d58cfae576584be28b93f15976a411af, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.446079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.459139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1329/2694] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:22:55 2022] PUT /identity/v3/projects/97a2d5a2afb34be58295ddc1586e9a31/users/d58cfae576584be28b93f15976a411af/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:22:55.464666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603154-e270-46d3-89c5-4afcdd06abd9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.464963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603154-e270-46d3-89c5-4afcdd06abd9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.465248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603154-e270-46d3-89c5-4afcdd06abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.482925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ed603154-e270-46d3-89c5-4afcdd06abd9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:55.484137 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ed603154-e270-46d3-89c5-4afcdd06abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:55.543832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1366/2695] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:22:55.553234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:55.555438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:55.611145 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf0ee4-eaa1-4b9e-bddc-287bd66eaad5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:55.614811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:55.615456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:55.615743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:55.616564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:55.625502 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:55.626937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:55.637497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1330/2696] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:22:59.777206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:59.777694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:59.777799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:59.806006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] MFA Rules not processed for user `d58cfae576584be28b93f15976a411af`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:22:59.807239 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:22:59.878320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1367/2697] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:22:59.883379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:59.893410 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707bbe-8ffa-4d7d-8a8b-aefd15ffe8be service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:59.898767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:22:59.899430 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:22:59.899713 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:22:59.899991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:22:59.900724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:22:59.902695 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:22:59.930314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1331/2698] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:22:59 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:22:59.934421 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:22:59.947166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138e149-4972-4d32-bf6a-2b634df2dfb0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:22:59.980113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:00.009208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:00.009897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:00.010206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:00.010486 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:00.011193 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:00.013190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:00.034485 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1368/2699] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:22:59 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:00.038464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:00.048883 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae404a3-27e5-4546-b4d4-2d03a475b346 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:00.054036 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:00.054714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:00.055001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:00.055281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:00.056019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:00.057676 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:00.068811 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1332/2700] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:00.073500 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:00.084135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f8e0-99f7-4770-a41a-21710d0cf67a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:00.089084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:00.089987 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:00.090344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:00.090582 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] PATH_INFO: `/v3/projects/aed60c31dbbc4085af755a374c51df99/users/31f2777df7d3461b8cd94e634496bb52/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:00.106520 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed60c31dbbc4085af755a374c51df99, user_id=31f2777df7d3461b8cd94e634496bb52, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:00.109468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:00.123554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1369/2701] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:00 2022] PUT /identity/v3/projects/aed60c31dbbc4085af755a374c51df99/users/31f2777df7d3461b8cd94e634496bb52/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:00.127517 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:00.138008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4774-e948-4140-8556-bc8112a9ee6e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:00.178405 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:00.198874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:00.199636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:00.199947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:00.200255 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:00.201012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:00.202647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d5b06-d938-4f54-95e2-5a4a68c3e4ad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:00.213651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1333/2702] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:00.217670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:00.230263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9e88-c399-4d01-aadc-aac8def7a4eb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:00.235554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:00.236586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:00.237168 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:00.237508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] PATH_INFO: `/v3/projects/aed60c31dbbc4085af755a374c51df99/users/31f2777df7d3461b8cd94e634496bb52/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:00.239685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed60c31dbbc4085af755a374c51df99, user_id=31f2777df7d3461b8cd94e634496bb52, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:00.242838 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:00.257284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1370/2703] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:00 2022] PUT /identity/v3/projects/aed60c31dbbc4085af755a374c51df99/users/31f2777df7d3461b8cd94e634496bb52/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:05.341759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0fab-e1f0-4edc-b89a-a35cd7bd5c4b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:05.342314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0fab-e1f0-4edc-b89a-a35cd7bd5c4b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:05.342314 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0fab-e1f0-4edc-b89a-a35cd7bd5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:05.374490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f18c0fab-e1f0-4edc-b89a-a35cd7bd5c4b None None] MFA Rules not processed for user `31f2777df7d3461b8cd94e634496bb52`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:05.376109 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f18c0fab-e1f0-4edc-b89a-a35cd7bd5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:05.463524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1334/2704] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:05.477961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:05.480178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:05.570007 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a982-631f-4f90-aa24-1e3eba6c2b09 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:05.574261 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:05.574793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:05.575246 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:05.575689 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:05.664142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:05.665222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:05.676543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1371/2705] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:05.790258 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:05.790560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:05.790853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:05.865424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:05.866808 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:05.953021 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1335/2706] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:06.005650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:06.007658 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:06.032933 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:06.107313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9d87a-f885-4a4d-8647-83a60022a7e8 service glance] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:06.112455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:06.113102 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:06.113399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:06.113679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:06.123593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:06.125278 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad354-55af-4ef1-8024-185da0a6a20b service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:06.134061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1372/2707] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 14:23:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:23:07.783103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:07.784983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:07.825494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:07.871880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1a1a0-4de2-4a7f-a55c-4fe906a6c518 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:07.877050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:07.878467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:07.879005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:07.879494 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] PATH_INFO: `/v3/users/d708cf1a81544fb68a164b3265e61f48` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:07.881012 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d708cf1a81544fb68a164b3265e61f48)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:07.883884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:07.954504 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd708cf1a81544fb68a164b3265e61f48'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:07.971743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd708cf1a81544fb68a164b3265e61f48'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:07.981261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd708cf1a81544fb68a164b3265e61f48'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:07.992784 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd708cf1a81544fb68a164b3265e61f48'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:07.994268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd708cf1a81544fb68a164b3265e61f48'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.001607 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1336/2708] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:07 2022] DELETE /identity/v3/users/d708cf1a81544fb68a164b3265e61f48 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:08.008646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:08.009212 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:08.009618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:08.034433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:08.036061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:08.119685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1373/2709] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:08.137820 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:08.139576 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:08.238171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7715-4455-45c6-a637-75ff4a4994a6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:08.242928 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:08.243596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:08.244449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:08.244449 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:08.256915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:08.258417 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:08.280179 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1337/2710] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:08.675879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:08.677456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:08.698707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1556-4fad-4d6d-b2a1-d9daa1f84205 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:08.706771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:08.708471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:08.708963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:08.710497 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] PATH_INFO: `/v3/projects/0515169577b243ce999666570a048fd3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:08.711942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0515169577b243ce999666570a048fd3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:08.714328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:08.789814 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0515169577b243ce999666570a048fd3', 'request_id': 'req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.799209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0515169577b243ce999666570a048fd3', 'request_id': 'req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.806375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0515169577b243ce999666570a048fd3', 'request_id': 'req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.819858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] The token cache is being invalidate because project 0515169577b243ce999666570a048fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:08.820157 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.820845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:08.822629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1374/2711] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:08 2022] DELETE /identity/v3/projects/0515169577b243ce999666570a048fd3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:08.826824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:08.837997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e81d-a010-4833-86f4-74ba7f0e2199 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:08.907002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:08.930267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:08.931716 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:08.932261 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:08.932729 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] PATH_INFO: `/v3/users/7b399b2d7267408eb68b3beb47ce4c62` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:08.934627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b399b2d7267408eb68b3beb47ce4c62)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:08.936958 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:09.072503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b399b2d7267408eb68b3beb47ce4c62'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.090497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b399b2d7267408eb68b3beb47ce4c62'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.106582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b399b2d7267408eb68b3beb47ce4c62'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.144940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b399b2d7267408eb68b3beb47ce4c62'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.145794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a018806-bf17-486f-8f1b-11ec0978789e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b399b2d7267408eb68b3beb47ce4c62'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.156855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1338/2712] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:08 2022] DELETE /identity/v3/users/7b399b2d7267408eb68b3beb47ce4c62 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:09.633449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:09.635465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:09.667120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2948c-2913-440b-b93f-d1c8e2bdf65c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:09.680950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:09.775191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:09.776639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:09.776931 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:09.777524 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] PATH_INFO: `/v3/projects/9b5e63ab08894d328252eaf99b2357a0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:09.779595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5e63ab08894d328252eaf99b2357a0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:09.786245 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:09.864529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5e63ab08894d328252eaf99b2357a0', 'request_id': 'req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.879033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5e63ab08894d328252eaf99b2357a0', 'request_id': 'req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.901419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5e63ab08894d328252eaf99b2357a0', 'request_id': 'req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.920331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] The token cache is being invalidate because project 9b5e63ab08894d328252eaf99b2357a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:09.920686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.921452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4e8f6ff0-f6bf-4e89-9154-982d586bcac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:09.923514 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1375/2713] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:09 2022] DELETE /identity/v3/projects/9b5e63ab08894d328252eaf99b2357a0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:09.929457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:09.929966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:09.930097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:09.953684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:09.955175 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:10.029265 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1339/2714] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:23:10.038297 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.038627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.038912 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.059545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:10.060832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:10.069593 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1376/2715] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:10.073569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.086350 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc7fc0-1b18-45b9-a537-604341bbf001 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.091337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.092044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.092364 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.092650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.093512 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:23:10.093822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.095463 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.111559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1340/2716] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:23:10.115569 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.130489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bcb08-8fb2-4b3c-aa6f-bcf66cecd049 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.135440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.136107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.136423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.136703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.137409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.139310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.171032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1377/2717] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:10.175320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.188435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b95b6-6326-4400-8e96-02f286e035d3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.247148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:10.258091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.258936 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.259683 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.260107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.260940 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.263278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.293845 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1341/2718] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:10.297851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.315862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bea65-f140-44e7-86bb-43d2e4bb337f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.329448 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.330086 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.330383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.330659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.331404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.333385 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.354324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1378/2719] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:10.355724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.371006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ea9c-afc5-476d-857d-dfa668c8f84e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.376477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.377162 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.377454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.377734 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.378478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.380116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdcba3-4be0-4e16-b1f0-c335a895fbe1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.400055 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1342/2720] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:10.401354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.412917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad40d-f99f-4d89-b050-769487cf3db6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.417835 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.418730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.419018 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.419303 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] PATH_INFO: `/v3/projects/d2f80553df2d427bb9779197e03ef2a1/users/dc89b3cf4f5241a6987589ed51b03211/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.444860 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f80553df2d427bb9779197e03ef2a1, user_id=dc89b3cf4f5241a6987589ed51b03211, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.447671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.481101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1379/2721] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:10 2022] PUT /identity/v3/projects/d2f80553df2d427bb9779197e03ef2a1/users/dc89b3cf4f5241a6987589ed51b03211/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:10.483184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.483483 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.483927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.516229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] MFA Rules not processed for user `dc89b3cf4f5241a6987589ed51b03211`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:10.517475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:10.619791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1343/2722] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:10.621479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.691026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:10.721204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b30e0-d577-43c2-9ef9-ba2438a9aa2b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.727254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.728015 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.728400 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.728763 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.729545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.732125 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.765469 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1380/2723] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:10.769522 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.783269 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce761a-c3fe-4c4b-a667-10801e0fcfc4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.884058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.885087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.885478 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.885768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.886477 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.888650 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.916868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1344/2724] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:10 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:10.920652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:10.936861 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1aa9f-86f0-4a97-b9fb-e337eb039913 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:10.941716 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:10.942393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:10.942681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:10.942957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:10.944238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:10.945850 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:10.987445 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1381/2725] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:10.993268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.005825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0776d5-96f1-4cf5-998f-5ee3919a7700 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.021394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.028029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.028360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.028819 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.029599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.033387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ffb4e-cb62-43f8-9fb3-e65e8608f031 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.063827 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1345/2726] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:11.065079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.082087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6171d-aaf9-4130-b2fc-384b1a74c072 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.091077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.091993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.092311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.092600 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] PATH_INFO: `/v3/projects/de4606137e3944fa839b18654871ad3b/users/66f0d35dc9b4458aaeaf68f4b47be568/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.125183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4606137e3944fa839b18654871ad3b, user_id=66f0d35dc9b4458aaeaf68f4b47be568, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.128463 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.175368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1382/2727] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:11 2022] PUT /identity/v3/projects/de4606137e3944fa839b18654871ad3b/users/66f0d35dc9b4458aaeaf68f4b47be568/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:11.186151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.186498 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.186912 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.219586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] MFA Rules not processed for user `66f0d35dc9b4458aaeaf68f4b47be568`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:11.221068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:11.267723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:11.316167 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1346/2728] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:11.320554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.423760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53960eb-706e-4670-822d-f804d8b19385 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.429992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.430659 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.430990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.431272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.432134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.434164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.464758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1383/2729] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:11 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:11.468902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.482959 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163743-a26a-4d0a-8046-4a02d879cb6d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.557064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.557989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.558343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.558723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.559505 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.561583 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.589627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1347/2730] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:11 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:11.593840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.607774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80d641-6d8b-4966-93e6-bb97135ae0f9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.618612 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.620655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.620948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.621332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.622300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.624344 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.642126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1384/2731] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:11.650614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.661532 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26a2a0-af1b-4a47-94c0-afc44691d30e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.670419 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.673554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.674627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.677341 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] PATH_INFO: `/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8/users/e771fdc16a964b4883ca451e860f606c/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.702647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e233a0b3062c4994b0e99ea04bc26cf8, user_id=e771fdc16a964b4883ca451e860f606c, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.705382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.725503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1348/2732] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:11 2022] PUT /identity/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8/users/e771fdc16a964b4883ca451e860f606c/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:11.729702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.742830 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cc5e-4fcb-449e-9b8d-f1b95f022de6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.829566 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.830373 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.830762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.831142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.832004 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.834829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7135fb6-9231-450b-ab0d-601ba162a498 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.847695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:11.862306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1385/2733] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:11.863561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:11.879525 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7160d8-b80a-46e2-91d2-5d3456f3efcd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:11.885997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:11.886995 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.887285 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.887569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] PATH_INFO: `/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8/users/e771fdc16a964b4883ca451e860f606c/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.889646 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e233a0b3062c4994b0e99ea04bc26cf8, user_id=e771fdc16a964b4883ca451e860f606c, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:11.892391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:11.909191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1349/2734] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:11 2022] PUT /identity/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8/users/e771fdc16a964b4883ca451e860f606c/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:11.923224 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:11.923577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:11.923972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:11.955108 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] MFA Rules not processed for user `e771fdc16a964b4883ca451e860f606c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:11.956782 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:12.043150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1386/2735] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:12.053805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:12.055748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:12.126069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962b82-1c60-409c-98c3-bc4b80d2ae48 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:12.130608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:12.132682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:12.132682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:12.132682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:12.144755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:12.146306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1224-777e-4450-9487-bf88e8066b87 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:12.158291 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1350/2736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:12.791388 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:12.793672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:12.808491 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14a5a9-89f8-4756-914d-702b39626618 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:12.812257 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:12.813003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:12.813354 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:12.813722 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:12.887900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:12.890280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:12.903969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1387/2737] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:15.939069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:15.939573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:15.939681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:15.959874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] MFA Rules not processed for user `d58cfae576584be28b93f15976a411af`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:15.961126 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:15.978983 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:16.016416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1351/2738] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:16.271294 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:16.272774 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:16.328546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131e8a-140d-4b3e-9416-828b1bdfb943 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:16.332114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:16.333033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:16.333322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:16.333604 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:16.335349 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:16.344701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:16.346142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e07894-6a9f-4309-8ee0-c177340dc59c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:16.354571 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1388/2739] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:17.050829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:17.061106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492859d3-adab-4a9e-85a4-bd0131e84a4d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:17.064614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:17.065251 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:17.065538 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:17.065815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:17.123228 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:17.124710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:17.134020 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1352/2740] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:18.973456 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:18.974025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:18.974134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:19.002198 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:19.005162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:19.031878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:19.092311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1389/2741] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 20 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:19.108520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:19.109962 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:19.205689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26389-822b-4699-81d2-6850068d826d service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:19.215626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:19.216567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:19.217102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:19.217598 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:19.229625 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:19.232234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a293c-3fde-418b-b954-ac8e700127ca service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:19.243915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1353/2742] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 14:23:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:23:19.366772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:19.522009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a2986-1b5c-4082-a3cd-a12ae7a32bfa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:19.537186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:19.538392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:19.538953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:19.539482 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] PATH_INFO: `/v3/users/dc89b3cf4f5241a6987589ed51b03211` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:19.543319 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc89b3cf4f5241a6987589ed51b03211)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:19.546648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:19.666235 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc89b3cf4f5241a6987589ed51b03211'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:19.667006 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc89b3cf4f5241a6987589ed51b03211'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:19.684236 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc89b3cf4f5241a6987589ed51b03211'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:19.729851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc89b3cf4f5241a6987589ed51b03211'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:19.745943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc89b3cf4f5241a6987589ed51b03211'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:19.758103 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1390/2743] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:19 2022] DELETE /identity/v3/users/dc89b3cf4f5241a6987589ed51b03211 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:19.763754 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:19.764147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:19.764561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:19.797551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:19.801667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:19.950783 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:19.982384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1354/2744] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:20.007399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:20.011317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:20.132402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f75b-ceca-42f7-bdb0-137c329bb706 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:20.139966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:20.141158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:20.141866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:20.143655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:20.156147 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:20.157750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:20.161392 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493848e-549f-4afb-bc8b-e8180ecb606f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:20.191087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1391/2745] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:21.387149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:21.389117 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:21.430630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:21.431551 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:21.432211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:21.470621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae530-578a-45b6-887a-c23ef4fffc6d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:21.482095 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:21.485122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:21.485422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:21.485747 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] PATH_INFO: `/v3/projects/d2f80553df2d427bb9779197e03ef2a1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:21.488407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] MFA Rules not processed for user `c2aa9f2c386647998cff8688be616660`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:21.490905 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f80553df2d427bb9779197e03ef2a1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:21.493086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:21.493281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:21.610644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f80553df2d427bb9779197e03ef2a1', 'request_id': 'req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.639393 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1392/2746] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:21.640001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f80553df2d427bb9779197e03ef2a1', 'request_id': 'req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.664934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f80553df2d427bb9779197e03ef2a1', 'request_id': 'req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.687462 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] The token cache is being invalidate because project d2f80553df2d427bb9779197e03ef2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:21.687920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.689873 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.693222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1355/2747] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:21 2022] DELETE /identity/v3/projects/d2f80553df2d427bb9779197e03ef2a1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:21.701655 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:21.717602 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9adc-e89e-4cbc-83b7-a3cbb960b789 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:21.803959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:21.805472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:21.805956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:21.806247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] PATH_INFO: `/v3/users/66f0d35dc9b4458aaeaf68f4b47be568` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:21.807526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f0d35dc9b4458aaeaf68f4b47be568)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:21.809646 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:21.878056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f0d35dc9b4458aaeaf68f4b47be568'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.879028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f0d35dc9b4458aaeaf68f4b47be568'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.888966 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f0d35dc9b4458aaeaf68f4b47be568'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.906819 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f0d35dc9b4458aaeaf68f4b47be568'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.920685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f0d35dc9b4458aaeaf68f4b47be568'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:21.931394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1393/2748] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:21 2022] DELETE /identity/v3/users/66f0d35dc9b4458aaeaf68f4b47be568 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:22.324469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:22.326072 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:22.354331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbf287-f5c3-4a0e-8ed7-21db649e1607 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:22.470789 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892591-807e-4314-a766-435f33b77172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:22.471809 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892591-807e-4314-a766-435f33b77172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:22.472318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892591-807e-4314-a766-435f33b77172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:22.472921 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892591-807e-4314-a766-435f33b77172 admin admin] PATH_INFO: `/v3/projects/de4606137e3944fa839b18654871ad3b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:22.474867 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892591-807e-4314-a766-435f33b77172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4606137e3944fa839b18654871ad3b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:22.477305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892591-807e-4314-a766-435f33b77172 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:22.568957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4606137e3944fa839b18654871ad3b', 'request_id': 'req-77892591-807e-4314-a766-435f33b77172'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.580281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4606137e3944fa839b18654871ad3b', 'request_id': 'req-77892591-807e-4314-a766-435f33b77172'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.590971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4606137e3944fa839b18654871ad3b', 'request_id': 'req-77892591-807e-4314-a766-435f33b77172'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.607835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] The token cache is being invalidate because project de4606137e3944fa839b18654871ad3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:22.608373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.609049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.611107 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1356/2749] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:22 2022] DELETE /identity/v3/projects/de4606137e3944fa839b18654871ad3b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:22.616034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:22.617824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:22.641096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f47ae-1ce5-4e8c-b21b-b97bbc498437 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:22.676314 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:22.825694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:22.826675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:22.827095 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:22.827473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] PATH_INFO: `/v3/users/e771fdc16a964b4883ca451e860f606c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:22.828842 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e771fdc16a964b4883ca451e860f606c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:22.831734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:22.934316 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e771fdc16a964b4883ca451e860f606c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.938743 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e771fdc16a964b4883ca451e860f606c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.956472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e771fdc16a964b4883ca451e860f606c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:22.990737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e771fdc16a964b4883ca451e860f606c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.000223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-157b1107-6523-4c77-8ff1-8c2ec01c677e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e771fdc16a964b4883ca451e860f606c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.011679 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1394/2750] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:22 2022] DELETE /identity/v3/users/e771fdc16a964b4883ca451e860f606c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:23.363965 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.366118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:23.380964 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892591-807e-4314-a766-435f33b77172 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:23.393326 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:23.462354 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:23.463262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.463552 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.463834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] PATH_INFO: `/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.465106 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e233a0b3062c4994b0e99ea04bc26cf8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:23.467040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:23.524050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e233a0b3062c4994b0e99ea04bc26cf8', 'request_id': 'req-c20795a4-772d-4e46-b2a0-f6d80d553cc4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.530872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e233a0b3062c4994b0e99ea04bc26cf8', 'request_id': 'req-c20795a4-772d-4e46-b2a0-f6d80d553cc4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.540000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e233a0b3062c4994b0e99ea04bc26cf8', 'request_id': 'req-c20795a4-772d-4e46-b2a0-f6d80d553cc4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.552693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] The token cache is being invalidate because project e233a0b3062c4994b0e99ea04bc26cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:23.552985 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.553669 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c20795a4-772d-4e46-b2a0-f6d80d553cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:23.555300 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1357/2751] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:23 2022] DELETE /identity/v3/projects/e233a0b3062c4994b0e99ea04bc26cf8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:23.561342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.561799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.562183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.582237 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:23.584855 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:23.674215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1395/2752] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:23:23.676580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.677050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.677574 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.699195 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:23.700871 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:23.711148 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1358/2753] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:23.716274 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.726619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30342e-5de6-4d78-adfb-7190e2e3ea72 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:23.737758 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:23.740107 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.740924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.741584 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.742775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:23:23.743280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:23.745415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:23.763358 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1396/2754] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:23:23.768988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.779733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ac3f-eec3-4e35-8deb-05cfa05393ad None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:23.786302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:23.787866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.788129 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.788441 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.789183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:23.791085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:23.819503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1359/2755] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:23 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:23.823660 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.835081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ad81-0ed6-4d6d-85a4-639a104b8211 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:23.866120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:23.912917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:23.913944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.914419 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.914703 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.915412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:23.918208 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:23.941085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1397/2756] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:23 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:23.945220 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.956416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c80a26-8c0b-4bd6-a640-7b48f490fbd8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:23.963276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:23.963979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:23.964301 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:23.964587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:23.965961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:23.967399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:23.983201 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1360/2757] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:23.984453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:23.997802 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7cc11-7d4a-4ae0-a47d-e68c518a726a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.004089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.005223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.005650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.006094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.006992 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.010876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf3508-c60c-4ae3-aee6-8359123e691e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.023222 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1398/2758] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:24.027331 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.045950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325b2e-3694-410c-84cc-124c79b639e3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.054011 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.055371 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.055771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.056154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] PATH_INFO: `/v3/projects/b0b1a8e83c0441199cbb993d3639aeb4/users/9a0e83d272e04cfe86c53291dec3a527/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.085531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b1a8e83c0441199cbb993d3639aeb4, user_id=9a0e83d272e04cfe86c53291dec3a527, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.088360 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.105374 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1361/2759] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:24 2022] PUT /identity/v3/projects/b0b1a8e83c0441199cbb993d3639aeb4/users/9a0e83d272e04cfe86c53291dec3a527/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:24.118709 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.119000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.119328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.148284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] MFA Rules not processed for user `9a0e83d272e04cfe86c53291dec3a527`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:24.149666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:24.271927 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1399/2760] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:24.276721 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.328982 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:24.354506 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03698cce-ef7b-4cd2-a2d5-436d87a391cc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.359688 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.360395 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.360702 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.360941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.361700 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.363768 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.395715 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1362/2761] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:24.397815 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.418206 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109ae3-152e-49bf-add6-aa15d5b525f1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.497625 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.498299 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.498585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.498862 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.499552 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.501534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.528402 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1400/2762] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:24.529452 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.542679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3e3d-2e1f-49f5-9cf2-f87119b2ffc3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.547745 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.548546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.548991 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.549287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.550122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.551853 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.565738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1363/2763] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:24.568501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.578982 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2d329-bc84-4677-988e-5ce493042486 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.585051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.586019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.586331 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.586745 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.587422 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.589512 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe8485-c890-4e62-a418-8611210c1e61 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.601968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1401/2764] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:24.605909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.616302 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99ecd3-5fb6-4f2f-9348-42a4679cca59 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.621614 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.622514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.622798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.623075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] PATH_INFO: `/v3/projects/8196f5b6bbec4f60bff5ac8d5dd6dfa3/users/2176a2565d8f495f9dcfd34e1f2101fb/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.640513 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8196f5b6bbec4f60bff5ac8d5dd6dfa3, user_id=2176a2565d8f495f9dcfd34e1f2101fb, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.645344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.662915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1364/2765] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:24 2022] PUT /identity/v3/projects/8196f5b6bbec4f60bff5ac8d5dd6dfa3/users/2176a2565d8f495f9dcfd34e1f2101fb/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:24.673079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.673361 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.673729 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.695671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:24.705049 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] MFA Rules not processed for user `2176a2565d8f495f9dcfd34e1f2101fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:24.706963 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:24.780876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1402/2766] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:24.785108 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.865531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a449c5e-9ba3-4f00-bcf9-46b37203bc3e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.871672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.872562 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.872855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.873154 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.873860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.882790 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:24.910369 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1365/2767] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:24.914320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:24.926996 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d02122-fe15-425e-860d-aaa9b40f27ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:24.991833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:24.992560 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:24.992893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:24.993175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:24.993921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:24.995824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.018877 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1403/2768] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:24 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:25.023087 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.036153 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1bb29-a225-4929-a9c1-ab4f0b506a32 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.041886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.042592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.042885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.043169 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.043938 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.045609 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.061642 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1366/2769] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:25.062793 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.073517 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c9fbf-f0d9-46f3-ac2d-866126af4ce2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.082044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.083218 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.083508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.083822 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] PATH_INFO: `/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83/users/94a4db2525eb49cfb234a0accb443258/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.100821 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e3b14ab6874750ac7b0d5c03898a83, user_id=94a4db2525eb49cfb234a0accb443258, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.103531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.118077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1404/2770] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:25 2022] PUT /identity/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83/users/94a4db2525eb49cfb234a0accb443258/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:25.121850 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.133115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7227855-f754-4f52-8d99-f54663a45bf1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.205118 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.206211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.206619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.206992 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.208248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.210254 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf820f-1ec5-4865-b939-7884f3d8db23 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.212762 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:25.226549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1367/2771] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:25.227418 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.238403 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e451-0434-411e-bd6c-9896808c44eb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.258603 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.259525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.259812 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.260090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] PATH_INFO: `/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83/users/94a4db2525eb49cfb234a0accb443258/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.262442 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e3b14ab6874750ac7b0d5c03898a83, user_id=94a4db2525eb49cfb234a0accb443258, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.265175 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.288902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1405/2772] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:25 2022] PUT /identity/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83/users/94a4db2525eb49cfb234a0accb443258/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:25.298920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.299218 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.299503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.344917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] MFA Rules not processed for user `94a4db2525eb49cfb234a0accb443258`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:25.346247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:25.428684 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1368/2773] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:25.436667 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.438467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:25.502640 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f9b5-3f04-4bf9-8330-cb59ec8eb2bc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.507127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.507856 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.508242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.508634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.516370 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:25.519347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.521247 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.532443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1406/2774] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:25.577902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:25.579539 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:25.597563 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369220-4284-462c-a64b-6309f2b20f2f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:25.602075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:25.602738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:25.603026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:25.603309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:25.674399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:25.675864 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d907-bf8a-49ae-a49f-19dae9c0d3bd service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:25.685690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1369/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:28.635817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:28.697921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020641c-bb90-4086-8cf3-1ee333eae95e service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:28.702543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:28.703408 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:28.703699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:28.703980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] PATH_INFO: `/v3/users/9a0e83d272e04cfe86c53291dec3a527` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:28.705192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0e83d272e04cfe86c53291dec3a527)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:28.707112 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:28.754543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0e83d272e04cfe86c53291dec3a527'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:28.755211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0e83d272e04cfe86c53291dec3a527'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:28.762885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0e83d272e04cfe86c53291dec3a527'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:28.775728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0e83d272e04cfe86c53291dec3a527'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:28.788014 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0e83d272e04cfe86c53291dec3a527'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:28.794532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1407/2776] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:28 2022] DELETE /identity/v3/users/9a0e83d272e04cfe86c53291dec3a527 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:28.798923 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:28.799470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:28.799470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:28.817049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:28.818769 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:28.889309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1370/2777] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:28.899272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:28.900759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:28.960764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff30af-c988-4da8-abae-d40929aefdb0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:28.964467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:28.965172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:28.965462 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:28.965747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:28.975375 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:28.976886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:28.986431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1408/2778] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:29.278040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:29.279464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:29.308764 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724351a8-524d-4236-8623-9bcc4c8a3149 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:29.321601 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:29.322489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:29.322774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:29.323063 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] PATH_INFO: `/v3/projects/b0b1a8e83c0441199cbb993d3639aeb4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:29.329939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b1a8e83c0441199cbb993d3639aeb4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:29.331533 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:29.358829 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:29.392751 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b1a8e83c0441199cbb993d3639aeb4', 'request_id': 'req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.402516 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b1a8e83c0441199cbb993d3639aeb4', 'request_id': 'req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.410996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b1a8e83c0441199cbb993d3639aeb4', 'request_id': 'req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.430340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] The token cache is being invalidate because project b0b1a8e83c0441199cbb993d3639aeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:29.430631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.431282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.433492 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1371/2779] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:29 2022] DELETE /identity/v3/projects/b0b1a8e83c0441199cbb993d3639aeb4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:29.437430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:29.448453 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b32a-1b17-4134-93de-19543625e8ae service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:29.460870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:29.506030 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:29.506898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:29.507183 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:29.507461 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] PATH_INFO: `/v3/users/2176a2565d8f495f9dcfd34e1f2101fb` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:29.508663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2176a2565d8f495f9dcfd34e1f2101fb)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:29.510607 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:29.555753 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2176a2565d8f495f9dcfd34e1f2101fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.556436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2176a2565d8f495f9dcfd34e1f2101fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.563605 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2176a2565d8f495f9dcfd34e1f2101fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.575369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2176a2565d8f495f9dcfd34e1f2101fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.582844 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2176a2565d8f495f9dcfd34e1f2101fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:29.590608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1409/2780] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:29 2022] DELETE /identity/v3/users/2176a2565d8f495f9dcfd34e1f2101fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:29.907097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:29.908815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:29.927941 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01a2e2-1d5d-4052-ab8d-5446fa5f6553 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:29.990947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:29.991825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:29.992115 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:29.992436 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] PATH_INFO: `/v3/projects/8196f5b6bbec4f60bff5ac8d5dd6dfa3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:29.993652 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8196f5b6bbec4f60bff5ac8d5dd6dfa3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:29.995914 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:30.047621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8196f5b6bbec4f60bff5ac8d5dd6dfa3', 'request_id': 'req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.053680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8196f5b6bbec4f60bff5ac8d5dd6dfa3', 'request_id': 'req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.066191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8196f5b6bbec4f60bff5ac8d5dd6dfa3', 'request_id': 'req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.077618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] The token cache is being invalidate because project 8196f5b6bbec4f60bff5ac8d5dd6dfa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:30.077917 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.078630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.080273 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1372/2781] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:29 2022] DELETE /identity/v3/projects/8196f5b6bbec4f60bff5ac8d5dd6dfa3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:30.084892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:30.086301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:30.099172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbffb-69b4-4074-9849-ebffdeb2f61b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:30.154917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:30.155799 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.156091 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.156405 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] PATH_INFO: `/v3/users/94a4db2525eb49cfb234a0accb443258` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.157652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a4db2525eb49cfb234a0accb443258)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:30.159619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:30.197900 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:30.204721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a4db2525eb49cfb234a0accb443258'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.205642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a4db2525eb49cfb234a0accb443258'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.213675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a4db2525eb49cfb234a0accb443258'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.226280 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a4db2525eb49cfb234a0accb443258'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.234089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-345642fe-5e1b-4782-9813-7adf857e4bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a4db2525eb49cfb234a0accb443258'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.240287 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1410/2782] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:30 2022] DELETE /identity/v3/users/94a4db2525eb49cfb234a0accb443258 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:30.537189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:30.539475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:30.564712 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf2ae-a968-452d-bbc3-73d8cadebbc9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:30.622206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:30.661996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:30.662861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.663141 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.663553 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] PATH_INFO: `/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.665455 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e3b14ab6874750ac7b0d5c03898a83)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:30.667618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:30.730980 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e3b14ab6874750ac7b0d5c03898a83', 'request_id': 'req-bdd342ca-a7aa-4558-85c8-69904a8ba18e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.738508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e3b14ab6874750ac7b0d5c03898a83', 'request_id': 'req-bdd342ca-a7aa-4558-85c8-69904a8ba18e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.748393 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e3b14ab6874750ac7b0d5c03898a83', 'request_id': 'req-bdd342ca-a7aa-4558-85c8-69904a8ba18e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.761373 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] The token cache is being invalidate because project d1e3b14ab6874750ac7b0d5c03898a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:30.761697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.762319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bdd342ca-a7aa-4558-85c8-69904a8ba18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:30.764086 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1373/2783] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:30 2022] DELETE /identity/v3/projects/d1e3b14ab6874750ac7b0d5c03898a83 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:30.769885 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.770177 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.770471 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.790002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:30.791805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:30.877971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1411/2784] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:30.886903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.887749 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.888388 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.918719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:30.922221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:30.934976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1374/2785] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:30.939464 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:30.950712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d1aa0-88f3-485f-9c7c-6d2e2d029f55 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:30.956292 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:30.956727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.957096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.957452 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.959503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:23:30.959887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:30.961651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:30.976752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1412/2786] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:23:30.981720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:30.992161 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3384c8-6c98-4f36-b793-070429148319 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:30.997585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:30.998365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:30.998723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:30.999104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:30.999887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.002714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.039481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.047615 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1375/2787] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:30 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:31.052976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332521f-bd7f-4263-852a-3f9dc48d68fd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.128057 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.128779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.129043 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.129336 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.130054 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.133166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.155457 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1413/2788] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:31 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:31.159802 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.176460 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914383bc-35ad-4230-ae3d-620fdd4b1275 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.182536 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.183834 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.184134 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.184918 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.185710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.188961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.202362 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1376/2789] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:31.206079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.218597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bcbf-8a14-40af-97a1-91c3f1eedbb0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.229956 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.231980 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.232308 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.232595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.233356 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.235214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf9483-de10-4b06-9361-709656606d9b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.247407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1414/2790] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:31.251558 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.264798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29653e9-1511-4ad1-b6c2-a4e3a8d61a65 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.274223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.275152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.275687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.275997 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] PATH_INFO: `/v3/projects/055c716ad8de41dcb7ef589f44e33292/users/3caf88c0567b424f95141c87dfe5d58f/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.293876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055c716ad8de41dcb7ef589f44e33292, user_id=3caf88c0567b424f95141c87dfe5d58f, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.298044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.314821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1377/2791] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:31 2022] PUT /identity/v3/projects/055c716ad8de41dcb7ef589f44e33292/users/3caf88c0567b424f95141c87dfe5d58f/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:31.327164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.327465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.327752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.511340 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] MFA Rules not processed for user `3caf88c0567b424f95141c87dfe5d58f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:31.512543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:31.522711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:31.608324 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1415/2792] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:31.612493 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.690017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db655627-dc34-4b05-8620-d635efe8aa35 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.695188 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.695854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.696143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.696457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.697164 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.699120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.703329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:31.727561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1378/2793] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:31 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:31.731685 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.743076 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ecc56-9546-4b09-aa7e-68db2dee413d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.808644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.809481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.809773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.810117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.810945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.813248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.837146 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1416/2794] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:31 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:31.841016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.853404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a2c8-ff84-492b-b281-6e4c5a04c43b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.858626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.859351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.859645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.859924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.860706 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.862346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.879531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.880617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1379/2795] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:31.891089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33644-862f-4d2f-b850-9081fba3ae31 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:31.897067 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:31.898081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:31.898254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:31.898532 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] PATH_INFO: `/v3/projects/df87792e33f2428ba19adb96db4cb870/users/66352f2a087e4c029593db77292c59ae/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:31.920534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df87792e33f2428ba19adb96db4cb870, user_id=66352f2a087e4c029593db77292c59ae, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:31.923113 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:31.939576 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1417/2796] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:31 2022] PUT /identity/v3/projects/df87792e33f2428ba19adb96db4cb870/users/66352f2a087e4c029593db77292c59ae/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:23:31.943770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:31.954815 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e16f-fd17-4297-a26c-9a74595a2fd1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:32.019692 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:32.020406 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:32.020704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:32.021152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:32.021902 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:32.023639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:32.036240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:32.038636 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1380/2797] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:23:32.043104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:32.045401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:32.067231 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5c3c6-d464-4077-8cba-2cd753585abb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:32.083587 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:32.084008 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:32.084337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:32.084626 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] PATH_INFO: `/v3/projects/df87792e33f2428ba19adb96db4cb870/users/66352f2a087e4c029593db77292c59ae/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:32.087015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df87792e33f2428ba19adb96db4cb870, user_id=66352f2a087e4c029593db77292c59ae, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:32.090040 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4812f-c230-410c-a80c-aa1d5fab44c0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:32.104147 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1381/2798] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:32 2022] PUT /identity/v3/projects/df87792e33f2428ba19adb96db4cb870/users/66352f2a087e4c029593db77292c59ae/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:23:32.116022 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:32.116356 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:32.116647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:32.176397 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] MFA Rules not processed for user `66352f2a087e4c029593db77292c59ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:32.178365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:32.186676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78ccab-73d0-482c-9f4e-b9fc2579fe5e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:32.203072 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:32.321904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:32.322580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:32.322867 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:32.324350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:32.327365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1382/2799] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:23:32.331720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:32.343535 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:32.345223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:32.353876 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:32.355599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:32.369519 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1418/2800] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:23:32.407144 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:32.422866 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647b64-7265-4b4b-b3af-37c48eb1f4d4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:32.431426 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:32.432094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:32.432412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:32.432698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:32.447606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:32.449132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73373f8e-b4c7-43ed-abe5-99412d0eadf8 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:32.460645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1383/2801] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:23:33.042637 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:33.104430 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89b55-bd0d-41f3-8882-7c7f48cd2c4e service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:33.109186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:33.110063 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:33.110348 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:33.110707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] PATH_INFO: `/v3/users/3caf88c0567b424f95141c87dfe5d58f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:33.111917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3caf88c0567b424f95141c87dfe5d58f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:33.113881 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:33.160085 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3caf88c0567b424f95141c87dfe5d58f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:33.160775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3caf88c0567b424f95141c87dfe5d58f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:33.167866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3caf88c0567b424f95141c87dfe5d58f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:33.180291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3caf88c0567b424f95141c87dfe5d58f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:33.187387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3caf88c0567b424f95141c87dfe5d58f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:33.193794 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1419/2802] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:33 2022] DELETE /identity/v3/users/3caf88c0567b424f95141c87dfe5d58f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:33.198559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:33.199047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:33.199222 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:33.217541 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:33.218796 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:33.278922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1384/2803] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:33.288501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:33.289879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:33.312152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:33.337851 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:33.339392 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:33.357692 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045663-3a9b-4201-b636-f2c8ec2281a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:33.362244 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:33.362896 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:33.363178 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:33.363504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:33.373327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:33.374805 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:33.385144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1420/2804] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:33.402891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bc97-5f04-4d5d-9a43-c208d54a8e9a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:33.407248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:33.408445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:33.408445 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:33.408728 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:33.410846 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:33.424446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:33.426048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:33.439103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1385/2805] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:23:34.124124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:34.125642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:34.138994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42b1a-23a8-4174-bf4b-26821af9d597 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:34.143549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:34.144431 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:34.144929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:34.145211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] PATH_INFO: `/v3/projects/055c716ad8de41dcb7ef589f44e33292` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:34.147000 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055c716ad8de41dcb7ef589f44e33292)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:34.148952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:34.194642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055c716ad8de41dcb7ef589f44e33292', 'request_id': 'req-e1106864-1938-4cc1-95a9-06041c5add73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.201562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055c716ad8de41dcb7ef589f44e33292', 'request_id': 'req-e1106864-1938-4cc1-95a9-06041c5add73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.207271 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055c716ad8de41dcb7ef589f44e33292', 'request_id': 'req-e1106864-1938-4cc1-95a9-06041c5add73'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.219476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] The token cache is being invalidate because project 055c716ad8de41dcb7ef589f44e33292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:34.219767 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.220507 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.222032 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1421/2806] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:34 2022] DELETE /identity/v3/projects/055c716ad8de41dcb7ef589f44e33292 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:34.225934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:34.237068 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266013a-3b62-4b1d-a077-ca9ecf14d5b5 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:34.295859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:34.296849 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:34.297150 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:34.297486 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] PATH_INFO: `/v3/users/66352f2a087e4c029593db77292c59ae` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:34.298759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=66352f2a087e4c029593db77292c59ae)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:34.300885 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:34.336876 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:34.352458 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66352f2a087e4c029593db77292c59ae'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.365079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66352f2a087e4c029593db77292c59ae'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.372091 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66352f2a087e4c029593db77292c59ae'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.379690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66352f2a087e4c029593db77292c59ae'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.380886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-5fe10bed-900e-46db-adce-2945559c0eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66352f2a087e4c029593db77292c59ae'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.387658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1386/2807] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:34 2022] DELETE /identity/v3/users/66352f2a087e4c029593db77292c59ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:34.742988 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:34.744455 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:34.760333 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106864-1938-4cc1-95a9-06041c5add73 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:34.822695 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:34.823557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:34.823840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:34.824109 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] PATH_INFO: `/v3/projects/df87792e33f2428ba19adb96db4cb870` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:34.825305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df87792e33f2428ba19adb96db4cb870)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:34.827199 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:34.875338 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:34.876521 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df87792e33f2428ba19adb96db4cb870', 'request_id': 'req-958d36b9-f782-4c64-924b-c46699e6238d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.887268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df87792e33f2428ba19adb96db4cb870', 'request_id': 'req-958d36b9-f782-4c64-924b-c46699e6238d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.896747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df87792e33f2428ba19adb96db4cb870', 'request_id': 'req-958d36b9-f782-4c64-924b-c46699e6238d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.908407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] The token cache is being invalidate because project df87792e33f2428ba19adb96db4cb870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:34.908788 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.909478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-958d36b9-f782-4c64-924b-c46699e6238d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:34.911036 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1422/2808] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:34 2022] DELETE /identity/v3/projects/df87792e33f2428ba19adb96db4cb870 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:34.916000 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:34.916330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:34.916618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:34.938869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:34.940618 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:35.011957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1387/2809] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:23:35.019302 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.020055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.020641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.047773 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:35.049282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:35.059706 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1423/2810] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:35.065471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.078127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a83f-fac9-4d0f-af68-227d1cd6b6dc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.085046 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.085854 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.086247 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.086631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.087524 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:23:35.088017 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.090026 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.104070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1388/2811] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:23:35.108035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.118210 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645d57-3122-4307-bfd6-ba6fe14fba81 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.123234 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.123886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.124172 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.124554 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.137215 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.137643 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.167866 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1424/2812] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:23:35 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:23:35.172621 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.183546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fb30-5f2a-43cf-9479-9e9bbcdc9edb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.256956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.257719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.258102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.258439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.259348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.261412 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.288904 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1389/2813] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:23:35 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:23:35.292990 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.303943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988326-3ff8-4e8a-b0e5-b42435ccd0f5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.309916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.310845 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.311878 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.312306 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.313481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.315437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.328971 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1425/2814] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:35.332454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.344979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3ad2-f4d1-4f18-8a4d-b5de8fa7a0be admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.350425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.351280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.351698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.352081 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.353243 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.355079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2deaf4-a38c-409a-a1a6-0c05e2368ef8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.367497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1390/2815] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:23:35.371725 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.383309 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375c0b-c7b5-4004-b0cd-8a372c076ca8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.389281 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.400781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.400781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.400781 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] PATH_INFO: `/v3/projects/388306fa10d84321a0ce123d4437a67b/users/a18ceb2dce1f415cb4d8041072b6bcfc/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.409320 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] RBAC: Authorizing `identity:create_grant(project_id=388306fa10d84321a0ce123d4437a67b, user_id=a18ceb2dce1f415cb4d8041072b6bcfc, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.412946 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.426650 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1426/2816] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:23:35 2022] PUT /identity/v3/projects/388306fa10d84321a0ce123d4437a67b/users/a18ceb2dce1f415cb4d8041072b6bcfc/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:35.436996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.437413 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.437698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.465340 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] MFA Rules not processed for user `a18ceb2dce1f415cb4d8041072b6bcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:35.466685 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:35.470596 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:35.535605 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1391/2817] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:23:35.546851 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:35.548549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:35.607254 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23753b-ca67-41f2-87a1-7fa8a609568a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:35.610836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:35.611504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:35.611790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:35.612066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:35.620317 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:35.621790 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e5b7-a872-45cd-be81-3c097b03f50c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:35.635185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1427/2818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:38.203887 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:38.267628 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb09f5a-f25e-4054-8394-c9484d5f8255 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:38.273016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:38.273891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:38.274174 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:38.274454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] PATH_INFO: `/v3/users/a18ceb2dce1f415cb4d8041072b6bcfc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:38.275634 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18ceb2dce1f415cb4d8041072b6bcfc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:38.277608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:38.330178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18ceb2dce1f415cb4d8041072b6bcfc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:38.343743 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18ceb2dce1f415cb4d8041072b6bcfc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:38.351414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18ceb2dce1f415cb4d8041072b6bcfc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:38.358759 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18ceb2dce1f415cb4d8041072b6bcfc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:38.359451 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18ceb2dce1f415cb4d8041072b6bcfc'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:38.365874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1392/2819] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:23:38 2022] DELETE /identity/v3/users/a18ceb2dce1f415cb4d8041072b6bcfc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:38.370415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:38.370905 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:38.371028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:38.387639 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:23:38.388907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:38.447902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1428/2820] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:23:38.457843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:38.459719 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:38.488578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:38.518966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54517-f22c-4432-a87e-a6bac2f5c192 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:38.523189 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:38.523837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:38.524127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:38.524435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:38.533276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:38.534724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:38.544050 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1393/2821] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:38.917268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:38.918809 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:38.933116 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3786-c202-4146-8ea1-1d96dd2e31d1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:38.937762 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:38.938627 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:38.938917 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:38.939197 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] PATH_INFO: `/v3/projects/388306fa10d84321a0ce123d4437a67b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:38.940451 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388306fa10d84321a0ce123d4437a67b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:38.942366 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:38.954654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:39.011301 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388306fa10d84321a0ce123d4437a67b', 'request_id': 'req-df188c8f-0eac-4ff9-a617-385ea91f7d65'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:39.019130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388306fa10d84321a0ce123d4437a67b', 'request_id': 'req-df188c8f-0eac-4ff9-a617-385ea91f7d65'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:39.025150 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388306fa10d84321a0ce123d4437a67b', 'request_id': 'req-df188c8f-0eac-4ff9-a617-385ea91f7d65'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:39.036284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] The token cache is being invalidate because project 388306fa10d84321a0ce123d4437a67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:23:39.036586 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:39.037249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-df188c8f-0eac-4ff9-a617-385ea91f7d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:23:39.038797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1429/2822] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:23:38 2022] DELETE /identity/v3/projects/388306fa10d84321a0ce123d4437a67b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:23:45.312294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:23:45.321507 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a95d-cd50-45d9-b2ee-5ea91fde0dd2 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:23:45.369280 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:23:45.369920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:23:45.370206 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:23:45.370487 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:23:45.372297 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:23:45.432874 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:23:45.434305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196fa8f-a9f8-456c-aca9-e8c690ccbb4e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:23:45.444733 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1394/2823] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:23:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:23:49.033184 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:23:55.439644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=65 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:24:29.828545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:24:29.829174 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:24:29.829378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:24:29.848248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] MFA Rules not processed for user `c2aa9f2c386647998cff8688be616660`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:24:29.849446 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:24:29.902964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1430/2824] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:24:39.896053 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=25 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:12.889675 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e220f-daca-4609-a895-9bc10348e6de None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:12.890171 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e220f-daca-4609-a895-9bc10348e6de None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:12.890281 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e220f-daca-4609-a895-9bc10348e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:12.907825 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-413e220f-daca-4609-a895-9bc10348e6de None None] MFA Rules not processed for user `ed9c934437f44bdfac79a7fab37a0626`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:25:12.909557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-413e220f-daca-4609-a895-9bc10348e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:12.963771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1395/2825] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 20 14:25:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:25:13.004264 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:13.005682 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:13.074772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aebb30-12fa-4fa4-8aa8-1658eb2ad828 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:13.079964 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd544be4d204445aa832e21033ba1a84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:13.081126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:13.081417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:13.081700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:13.091066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:13.092730 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:13.101915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1431/2826] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 20 14:25:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:25:19.472989 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e220f-daca-4609-a895-9bc10348e6de None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:19.474858 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-413e220f-daca-4609-a895-9bc10348e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:19.561939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e220f-daca-4609-a895-9bc10348e6de None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:19.567788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:19.568723 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:19.569001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:19.569479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] PATH_INFO: `/v3/users/d58cfae576584be28b93f15976a411af` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:19.571644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58cfae576584be28b93f15976a411af)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:19.574581 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:19.638686 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58cfae576584be28b93f15976a411af'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:19.651582 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58cfae576584be28b93f15976a411af'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:19.658591 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58cfae576584be28b93f15976a411af'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:19.668572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58cfae576584be28b93f15976a411af'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:19.669282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58cfae576584be28b93f15976a411af'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:19.676076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1396/2827] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:25:19 2022] DELETE /identity/v3/users/d58cfae576584be28b93f15976a411af => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:25:19.868728 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:19.881858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ca57b-15f6-430a-9229-c41f365749c9 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:19.969921 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:19.971328 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:19.971616 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:19.971898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] PATH_INFO: `/v3/projects/97a2d5a2afb34be58295ddc1586e9a31` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:19.973119 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a2d5a2afb34be58295ddc1586e9a31)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:19.975026 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:20.024741 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a2d5a2afb34be58295ddc1586e9a31', 'request_id': 'req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.033887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a2d5a2afb34be58295ddc1586e9a31', 'request_id': 'req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.039750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a2d5a2afb34be58295ddc1586e9a31', 'request_id': 'req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.053372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] The token cache is being invalidate because project 97a2d5a2afb34be58295ddc1586e9a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:25:20.053666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.054313 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.055947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1432/2828] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:25:19 2022] DELETE /identity/v3/projects/97a2d5a2afb34be58295ddc1586e9a31 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:25:20.059901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:20.061425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:20.074608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328b08-0e1f-4050-a87e-208646fa68cb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:20.094627 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:20.133111 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:20.133986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:20.134276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:20.134557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] PATH_INFO: `/v3/users/31f2777df7d3461b8cd94e634496bb52` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:20.135835 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f2777df7d3461b8cd94e634496bb52)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:20.137831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:20.183708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f2777df7d3461b8cd94e634496bb52'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.195939 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f2777df7d3461b8cd94e634496bb52'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.202720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f2777df7d3461b8cd94e634496bb52'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.210469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f2777df7d3461b8cd94e634496bb52'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.211102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4aa55eff-0497-4150-9ad8-194e96e1935f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f2777df7d3461b8cd94e634496bb52'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.217236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1397/2829] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:25:20 2022] DELETE /identity/v3/users/31f2777df7d3461b8cd94e634496bb52 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:25:20.390318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:20.391755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:20.405614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b22fe-6b1b-4ea2-9546-c6fcc996cf1e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:20.423654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:20.463824 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:20.464717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:20.464995 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:20.465268 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] PATH_INFO: `/v3/projects/aed60c31dbbc4085af755a374c51df99` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:20.466426 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed60c31dbbc4085af755a374c51df99)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:20.468608 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:20.513149 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed60c31dbbc4085af755a374c51df99', 'request_id': 'req-483433e7-c442-4de3-b090-111efea3aee3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.520803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed60c31dbbc4085af755a374c51df99', 'request_id': 'req-483433e7-c442-4de3-b090-111efea3aee3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.526557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed60c31dbbc4085af755a374c51df99', 'request_id': 'req-483433e7-c442-4de3-b090-111efea3aee3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.537436 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] The token cache is being invalidate because project aed60c31dbbc4085af755a374c51df99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:25:20.537727 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.538347 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:25:20.539890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1433/2830] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:25:20 2022] DELETE /identity/v3/projects/aed60c31dbbc4085af755a374c51df99 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:25:30.213937 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:30.534383 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:33.276082 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:33.276611 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:33.276726 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:33.306456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] MFA Rules not processed for user `c2aa9f2c386647998cff8688be616660`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:25:33.307701 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:33.377151 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1398/2831] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:25:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:25:39.128590 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:25:39.130009 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:39.259606 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483433e7-c442-4de3-b090-111efea3aee3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:25:39.264711 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:25:39.265355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:25:39.265641 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:25:39.265934 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:25:39.267688 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:25:39.279365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:25:39.280991 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:25:39.291720 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1434/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:25:43.374979 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=37 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:25:49.287123 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=59 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:41.265569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:41.267196 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:41.349886 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6292-e4c1-4278-902b-78bd90608ac4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:41.354442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:41.355318 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.355606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.355884 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] PATH_INFO: `/v3/users/c2aa9f2c386647998cff8688be616660` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.357128 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2aa9f2c386647998cff8688be616660)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:41.359077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:41.403996 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2aa9f2c386647998cff8688be616660'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.416304 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2aa9f2c386647998cff8688be616660'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.423204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2aa9f2c386647998cff8688be616660'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.431671 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2aa9f2c386647998cff8688be616660'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.432387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-dedb75f6-c78f-4c61-a1b5-80242f136973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2aa9f2c386647998cff8688be616660'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.438308 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1399/2833] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:26:41 2022] DELETE /identity/v3/users/c2aa9f2c386647998cff8688be616660 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:26:41.608279 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:41.619723 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d24a-af6d-4246-adb1-541b8d2679a3 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:41.676547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:41.677414 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.677704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.677985 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] PATH_INFO: `/v3/projects/f2321a0eb5ea4a99864bcbff6365d538` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.679191 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2321a0eb5ea4a99864bcbff6365d538)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:41.681188 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:41.727231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2321a0eb5ea4a99864bcbff6365d538', 'request_id': 'req-f4bfbd58-59f1-4714-832c-a4c49f8727e9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.734750 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2321a0eb5ea4a99864bcbff6365d538', 'request_id': 'req-f4bfbd58-59f1-4714-832c-a4c49f8727e9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.740105 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2321a0eb5ea4a99864bcbff6365d538', 'request_id': 'req-f4bfbd58-59f1-4714-832c-a4c49f8727e9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.750786 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] The token cache is being invalidate because project f2321a0eb5ea4a99864bcbff6365d538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:26:41.751074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.751694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4bfbd58-59f1-4714-832c-a4c49f8727e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:41.753241 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1435/2834] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:26:41 2022] DELETE /identity/v3/projects/f2321a0eb5ea4a99864bcbff6365d538 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:41.758272 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.758572 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.758861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.777139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:41.778345 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:41.836330 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1400/2835] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:41.844060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.844409 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.844726 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.862828 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:41.863999 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:41.871702 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1436/2836] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:41.875612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:41.885470 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dbaff-1ba2-45d9-83cb-e9b2199cfe57 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:41.890058 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:41.890710 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.891019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.891296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.892016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:26:41.892375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:41.893975 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:41.905837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1401/2837] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:26:41.910190 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:41.919291 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4d0e-6ec7-4722-a904-d343cfa2f9df None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:41.923810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:41.924473 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:41.924759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:41.925034 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:41.926226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:41.928114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:41.953394 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1437/2838] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:26:41 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:41.957740 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:41.967838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175083ff-b779-486a-9009-864c85d8d808 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:41.971549 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:42.025748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.026346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.026637 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.026920 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.027619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.029573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.049349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1402/2839] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:26:41 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:42.053967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.064404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bb51-33dc-4d99-bfbd-46d742e2b554 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.068969 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.069622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.069908 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.070186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.070907 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.072541 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.083019 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1438/2840] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:42.086956 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.096857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a779-a1fd-406c-90db-6e810ad29607 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.102047 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.102697 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.102986 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.103267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.104014 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.105629 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be61ab6-ce20-4f36-b1f4-07baea39ad1c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.115926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1403/2841] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:42.119945 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.129870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9ce3-d01e-4ace-8ea2-f3d2acb1b751 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.134503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.135372 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.135662 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.135940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] PATH_INFO: `/v3/projects/a6f59e0e07864d85bf72e4f73c521ad0/users/5c284d2471ae44a6ad9717ad739780c9/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.150327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f59e0e07864d85bf72e4f73c521ad0, user_id=5c284d2471ae44a6ad9717ad739780c9, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.153025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.166185 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1439/2842] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:42 2022] PUT /identity/v3/projects/a6f59e0e07864d85bf72e4f73c521ad0/users/5c284d2471ae44a6ad9717ad739780c9/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:42.223266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.223556 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.223837 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.250744 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] MFA Rules not processed for user `5c284d2471ae44a6ad9717ad739780c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:42.251950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:42.315425 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1404/2843] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:42.319918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.349998 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:42.382760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01991b-1079-407a-8935-2be2e84d0645 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.387288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.387935 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.388240 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.388522 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.389226 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.391118 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.417365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1440/2844] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:42.421453 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.432182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242ce0d-b872-4af2-bfd5-68195373dc5e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.491681 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.492382 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.492670 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.492950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.493654 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.495557 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.514947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1405/2845] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:26:42 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:42.519534 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.529903 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988ab84-a69b-41a4-93e5-d3e49b0b0420 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.534649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.535950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.536272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.536557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.537282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.538897 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.550002 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1441/2846] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:42.554044 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.560351 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:42.564786 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43b72-88e5-43d9-a8a4-b7302fc4bb40 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.570855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.571679 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.571970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.572287 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] PATH_INFO: `/v3/projects/fec60d20ea614389afaf3486b0d0c635/users/5360e2aaf23e480aadc69d8c845ca891/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.587828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec60d20ea614389afaf3486b0d0c635, user_id=5360e2aaf23e480aadc69d8c845ca891, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.590559 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.604143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1406/2847] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:42 2022] PUT /identity/v3/projects/fec60d20ea614389afaf3486b0d0c635/users/5360e2aaf23e480aadc69d8c845ca891/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:42.608005 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.618079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a438-d996-4cc7-b25a-1e684d0d7207 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.675776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.676791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.677080 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.677360 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.678094 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.679699 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ed5b-8671-4a1e-ba97-c309a7e7ca45 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.689765 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1442/2848] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:42.694054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.704097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b5025-1f29-4b94-87bd-88246d004ca3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.709457 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.710327 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.710616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.710892 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] PATH_INFO: `/v3/projects/fec60d20ea614389afaf3486b0d0c635/users/5360e2aaf23e480aadc69d8c845ca891/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.712869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec60d20ea614389afaf3486b0d0c635, user_id=5360e2aaf23e480aadc69d8c845ca891, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.715491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.726284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1407/2849] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:42 2022] PUT /identity/v3/projects/fec60d20ea614389afaf3486b0d0c635/users/5360e2aaf23e480aadc69d8c845ca891/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:42.736916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.737285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.738797 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.763970 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] MFA Rules not processed for user `5360e2aaf23e480aadc69d8c845ca891`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:42.765365 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:42.842029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1443/2850] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:42.853316 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:42.854972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:42.912379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a0e06-92d9-4d2c-a812-26a424169ae4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:42.915970 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:42.916639 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:42.916929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:42.917210 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:42.926190 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:42.927635 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf19565-1fcd-4cdf-8044-c604e5b004c3 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:42.937027 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1408/2851] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:26:43.317258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:43.341836 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:43.379801 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d3ea-0fda-450f-a982-212d77cff712 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:43.384251 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:43.385115 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:43.385398 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:43.385672 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] PATH_INFO: `/v3/users/5c284d2471ae44a6ad9717ad739780c9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:43.386847 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c284d2471ae44a6ad9717ad739780c9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:43.388811 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:43.434079 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c284d2471ae44a6ad9717ad739780c9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:43.434739 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c284d2471ae44a6ad9717ad739780c9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:43.442282 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c284d2471ae44a6ad9717ad739780c9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:43.453952 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c284d2471ae44a6ad9717ad739780c9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:43.461544 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c284d2471ae44a6ad9717ad739780c9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:43.467529 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1444/2852] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:26:43 2022] DELETE /identity/v3/users/5c284d2471ae44a6ad9717ad739780c9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:43.472070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:43.472619 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:43.472748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:43.490007 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:43.491208 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:43.550472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1409/2853] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:43.560648 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:43.562060 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:43.633404 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0243-e87c-4cbf-bdd9-33fa5b07dfc9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:43.637779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:43.638429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:43.638714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:43.638993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:43.648478 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:43.649919 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:43.659391 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1445/2854] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:26:43.925514 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:43.926960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:43.939135 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7665-c441-4419-80c8-366d8aeea772 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:43.944048 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:43.944950 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:43.945234 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:43.945519 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] PATH_INFO: `/v3/projects/a6f59e0e07864d85bf72e4f73c521ad0` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:43.947464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f59e0e07864d85bf72e4f73c521ad0)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:43.949542 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:43.996608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f59e0e07864d85bf72e4f73c521ad0', 'request_id': 'req-4b582a26-694c-4ade-b1d9-d07e1a9d6479'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.002122 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f59e0e07864d85bf72e4f73c521ad0', 'request_id': 'req-4b582a26-694c-4ade-b1d9-d07e1a9d6479'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.009651 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f59e0e07864d85bf72e4f73c521ad0', 'request_id': 'req-4b582a26-694c-4ade-b1d9-d07e1a9d6479'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.010777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:44.024005 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] The token cache is being invalidate because project a6f59e0e07864d85bf72e4f73c521ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:26:44.024320 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.024976 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.026497 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1410/2855] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:26:43 2022] DELETE /identity/v3/projects/a6f59e0e07864d85bf72e4f73c521ad0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:44.030644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.041071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374632-fb52-4900-8ba1-8d6c1e0bad20 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.070397 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:44.100011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.100918 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.101207 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.101489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] PATH_INFO: `/v3/users/5360e2aaf23e480aadc69d8c845ca891` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.102676 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5360e2aaf23e480aadc69d8c845ca891)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.104649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.151350 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5360e2aaf23e480aadc69d8c845ca891'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.152258 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5360e2aaf23e480aadc69d8c845ca891'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.160300 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5360e2aaf23e480aadc69d8c845ca891'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.172090 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5360e2aaf23e480aadc69d8c845ca891'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.179169 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d911b7cc-28e9-49a1-b369-a738982ecddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5360e2aaf23e480aadc69d8c845ca891'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.185044 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1446/2856] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:26:44 2022] DELETE /identity/v3/users/5360e2aaf23e480aadc69d8c845ca891 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:44.450317 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.451794 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:44.467223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582a26-694c-4ade-b1d9-d07e1a9d6479 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.524075 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.524967 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.525253 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.525531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] PATH_INFO: `/v3/projects/fec60d20ea614389afaf3486b0d0c635` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.526720 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec60d20ea614389afaf3486b0d0c635)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.528680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.574416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec60d20ea614389afaf3486b0d0c635', 'request_id': 'req-1ef47cc8-3fe4-413f-b9f8-761809807020'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.579894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec60d20ea614389afaf3486b0d0c635', 'request_id': 'req-1ef47cc8-3fe4-413f-b9f8-761809807020'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.587193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec60d20ea614389afaf3486b0d0c635', 'request_id': 'req-1ef47cc8-3fe4-413f-b9f8-761809807020'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.598612 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] The token cache is being invalidate because project fec60d20ea614389afaf3486b0d0c635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:26:44.598922 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.599638 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1ef47cc8-3fe4-413f-b9f8-761809807020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:44.601361 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1411/2857] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:26:44 2022] DELETE /identity/v3/projects/fec60d20ea614389afaf3486b0d0c635 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:44.606476 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.606772 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.607055 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.625498 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:44.626714 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:44.685832 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1447/2858] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:44.693741 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.693981 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.694267 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.713016 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:44.714209 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:44.721869 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1412/2859] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:44.726806 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.736440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6205-7dfc-465e-84e1-fc272ce308e1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.740916 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.741555 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.741837 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.742110 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.742826 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:26:44.743130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.744764 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.755993 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1448/2860] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:26:44.760121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.769872 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528ea5-5ce2-4c1a-85f5-19c94906c923 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.774500 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.775143 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.775431 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.775711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.776432 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.778337 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.804053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1413/2861] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:26:44 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:44.808042 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.818051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46002e-8751-4d0d-8ba7-dee5358aab9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.863389 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:44.887164 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.887839 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.888126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.888437 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.889154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.891101 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.912062 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1449/2862] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:26:44 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:44.916183 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.926593 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d29f-1ffb-40c0-90d6-d5509a94b365 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.931288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.931947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.932264 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.932551 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.933284 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.934895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.945473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1414/2863] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:44.949078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.960121 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3552c-767b-4d1e-b7e2-44695bbd6a1e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.964929 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.965599 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.965914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.966196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:44.966915 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:44.968539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7367-4130-4fc3-a9ce-66c982f2461a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:44.978924 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1450/2864] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:44.982960 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:44.993198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d676-78d1-401b-a4bf-e252a2876bc3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:44.997777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:44.998644 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:44.998929 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:44.999205 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] PATH_INFO: `/v3/projects/72a18795f3b94c74b88520372bc8ffab/users/be8698d0894d479aaedf29b129d1d1af/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.013999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a18795f3b94c74b88520372bc8ffab, user_id=be8698d0894d479aaedf29b129d1d1af, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.016705 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.030193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1415/2865] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:44 2022] PUT /identity/v3/projects/72a18795f3b94c74b88520372bc8ffab/users/be8698d0894d479aaedf29b129d1d1af/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:45.041644 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.041940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.042223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.068380 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] MFA Rules not processed for user `be8698d0894d479aaedf29b129d1d1af`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:45.069583 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:45.132003 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1451/2866] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:45.136437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.157875 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:45.201696 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047383-3d95-41b0-8eb2-bcd8c674fd99 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.207137 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.207797 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.208085 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.208396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.209090 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.210999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.235149 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1416/2867] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:26:45 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:45.239311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.249898 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce2e22-f408-462d-8bc7-1fc31231648f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.305428 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.306097 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.306387 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.306666 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.307368 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.309322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.328972 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1452/2868] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:26:45 2022] POST /identity/v3/users => generated 306 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:45.334062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.344704 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34f09-9fff-4373-8ae5-0ba18ec5266e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.349309 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.349972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.350262 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.350546 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.351276 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.352926 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.363578 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1417/2869] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:45.367779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.377705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d897c56-f074-4e68-8a0d-fe3d889d52b8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.382791 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.383669 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.383957 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.384275 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] PATH_INFO: `/v3/projects/376120f2e77e448bb2be6426af8c5b14/users/f9b82c74a1324fc5a967847e2b7f7db8/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.399386 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376120f2e77e448bb2be6426af8c5b14, user_id=f9b82c74a1324fc5a967847e2b7f7db8, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.402074 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.414681 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1453/2870] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:45 2022] PUT /identity/v3/projects/376120f2e77e448bb2be6426af8c5b14/users/f9b82c74a1324fc5a967847e2b7f7db8/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:45.418579 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.429855 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8c5c-a555-4227-8311-da84c3fbf7c1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.489131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.489805 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.490096 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.490377 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.491113 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.492778 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56304de8-5aa3-436a-841f-546fac9c3435 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.502658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1418/2871] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:45.507433 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.517887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17efb-76de-4a16-a1eb-359a413fd220 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.522651 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.523675 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.524025 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.524343 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] PATH_INFO: `/v3/projects/376120f2e77e448bb2be6426af8c5b14/users/f9b82c74a1324fc5a967847e2b7f7db8/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.526334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376120f2e77e448bb2be6426af8c5b14, user_id=f9b82c74a1324fc5a967847e2b7f7db8, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.529012 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.535089 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:45.540516 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1454/2872] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:45 2022] PUT /identity/v3/projects/376120f2e77e448bb2be6426af8c5b14/users/f9b82c74a1324fc5a967847e2b7f7db8/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:45.551069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.551580 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.551689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.577491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] MFA Rules not processed for user `f9b82c74a1324fc5a967847e2b7f7db8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:45.578689 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:45.647599 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1419/2873] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:45.658029 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.659755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:45.717028 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160f24-8c0d-4221-ad9a-0357ddd40135 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.720752 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.721334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:45.721623 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:45.721904 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:45.730922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:45.732395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:45.742318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1455/2874] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:26:45.985399 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:45.995682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ed029-ea1b-4c6c-b132-f6c01403d8f8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:45.999170 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:45.999814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:46.000102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:46.000414 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:46.012099 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:46.057859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:46.059315 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fbaad-9e20-42c6-a84b-2aa3d472d557 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:46.068687 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1420/2875] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:26:50.071944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:50.133189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19190f62-d30e-4420-861b-a9c0fca18ff5 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:50.137735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:50.138595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:50.138883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:50.139163 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] PATH_INFO: `/v3/users/be8698d0894d479aaedf29b129d1d1af` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:50.140378 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8698d0894d479aaedf29b129d1d1af)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:50.142305 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:50.188326 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8698d0894d479aaedf29b129d1d1af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.188889 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8698d0894d479aaedf29b129d1d1af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.195654 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8698d0894d479aaedf29b129d1d1af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.207503 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8698d0894d479aaedf29b129d1d1af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.214663 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8698d0894d479aaedf29b129d1d1af'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.220536 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1456/2876] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:26:50 2022] DELETE /identity/v3/users/be8698d0894d479aaedf29b129d1d1af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:50.225554 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147634cd-3757-4118-9480-f777c94231a3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:50.226045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147634cd-3757-4118-9480-f777c94231a3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:50.226152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147634cd-3757-4118-9480-f777c94231a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:50.244223 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-147634cd-3757-4118-9480-f777c94231a3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:50.245434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-147634cd-3757-4118-9480-f777c94231a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:50.304680 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1421/2877] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:50.314132 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:50.315610 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:50.342272 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:50.375231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7b1f-a2a4-45d0-9559-bd25092aaa1c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:50.378887 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:50.379526 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:50.379810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:50.380087 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:50.388976 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:50.390429 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:50.400213 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1457/2878] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:26:50.663859 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147634cd-3757-4118-9480-f777c94231a3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:50.665475 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-147634cd-3757-4118-9480-f777c94231a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:50.677755 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147634cd-3757-4118-9480-f777c94231a3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:50.682343 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:50.683211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:50.683499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:50.683780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] PATH_INFO: `/v3/projects/72a18795f3b94c74b88520372bc8ffab` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:50.685024 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a18795f3b94c74b88520372bc8ffab)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:50.686943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:50.733949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a18795f3b94c74b88520372bc8ffab', 'request_id': 'req-d95f7751-901d-4849-9bb3-468f6799cc5d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.739746 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a18795f3b94c74b88520372bc8ffab', 'request_id': 'req-d95f7751-901d-4849-9bb3-468f6799cc5d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.747239 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a18795f3b94c74b88520372bc8ffab', 'request_id': 'req-d95f7751-901d-4849-9bb3-468f6799cc5d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.758610 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] The token cache is being invalidate because project 72a18795f3b94c74b88520372bc8ffab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:26:50.758903 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.759570 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.761133 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1422/2879] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:26:50 2022] DELETE /identity/v3/projects/72a18795f3b94c74b88520372bc8ffab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:50.765084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:50.775940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbec1-04de-4d80-9ff6-42096c98e25d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:50.830715 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:50.832412 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:50.832701 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:50.832978 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] PATH_INFO: `/v3/users/f9b82c74a1324fc5a967847e2b7f7db8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:50.834162 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b82c74a1324fc5a967847e2b7f7db8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:50.836092 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:50.883810 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b82c74a1324fc5a967847e2b7f7db8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.884775 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b82c74a1324fc5a967847e2b7f7db8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.893136 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b82c74a1324fc5a967847e2b7f7db8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.905708 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b82c74a1324fc5a967847e2b7f7db8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.913377 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3baca006-d60a-4486-8c67-eb3ff5f1e5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b82c74a1324fc5a967847e2b7f7db8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:50.919489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1458/2880] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:26:50 2022] DELETE /identity/v3/users/f9b82c74a1324fc5a967847e2b7f7db8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:51.198110 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.199658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:51.213490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f7751-901d-4849-9bb3-468f6799cc5d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.249079 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:51.275089 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.275889 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.276178 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.276495 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] PATH_INFO: `/v3/projects/376120f2e77e448bb2be6426af8c5b14` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.277717 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=376120f2e77e448bb2be6426af8c5b14)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.279658 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.326305 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376120f2e77e448bb2be6426af8c5b14', 'request_id': 'req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:51.332216 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376120f2e77e448bb2be6426af8c5b14', 'request_id': 'req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:51.338748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376120f2e77e448bb2be6426af8c5b14', 'request_id': 'req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:51.349738 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] The token cache is being invalidate because project 376120f2e77e448bb2be6426af8c5b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:26:51.350029 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:51.350667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-89f87ea5-fb26-4b2c-8dc4-1b31376f1c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:26:51.352204 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1423/2881] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:26:51 2022] DELETE /identity/v3/projects/376120f2e77e448bb2be6426af8c5b14 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:26:51.357166 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.357630 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.357734 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.375712 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:51.376961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:51.418481 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:26:51.439263 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1459/2882] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:51.448518 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.448824 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.449114 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.467608 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:51.468852 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:51.477434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1424/2883] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:51.481719 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.491953 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0783c6-b0d5-4e65-abdf-d9dacc317e9d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.496489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.497135 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.497417 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.497694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.498411 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:26:51.498718 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.500342 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.511721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1460/2884] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:26:51.515798 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.525064 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803c7e-d302-402b-a27d-40f7e280729f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.529799 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.530543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.530821 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.531094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.531803 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.533724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.561391 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1425/2885] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:26:51 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:51.563472 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.573549 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fea39-2bdb-421f-b418-7933b169b512 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.630259 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.630959 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.631248 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.631539 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.632285 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.634205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.655209 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1461/2886] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:26:51 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:26:51.659266 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.671366 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5579a-147d-48b7-a823-813cec92a356 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.676076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.676767 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.677056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.677336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.678069 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.679682 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.691748 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1426/2887] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:51.695547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.705407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48a649-85f5-4a25-bd44-b325d241ec00 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.710936 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.711595 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.711879 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.712152 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.712914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.714618 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a8087-bfc2-4dca-96d1-c2af7b422fe7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.724707 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1462/2888] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:26:51.728861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.738860 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e28ca-58d2-4907-af7c-975a9cd30ed2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.743427 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.744333 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.744623 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.744899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] PATH_INFO: `/v3/projects/004ed073b8a54a9591ac875f64c69030/users/bfb7dbec22c64e06b9648da3edf8525b/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.759909 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004ed073b8a54a9591ac875f64c69030, user_id=bfb7dbec22c64e06b9648da3edf8525b, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.762600 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.776283 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1427/2889] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:26:51 2022] PUT /identity/v3/projects/004ed073b8a54a9591ac875f64c69030/users/bfb7dbec22c64e06b9648da3edf8525b/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:26:51.786737 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.786967 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.787249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.813548 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] MFA Rules not processed for user `bfb7dbec22c64e06b9648da3edf8525b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:26:51.814740 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:51.876557 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1463/2890] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:26:51.889213 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:26:51.890984 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:26:51.946901 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900597-f95f-4c3e-aa56-4ada636c06f6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:26:51.950616 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9ef87632c49399f3ec6a92ce92709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:26:51.951256 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:26:51.951544 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:26:51.951826 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:26:51.961752 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:26:51.963191 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b323b0-25a5-4c29-a3f1-c0eb645833b2 service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:26:51.972157 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1428/2891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:27:01.873634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:01.967943 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:08.422670 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:08.483196 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c4e9b-ff5e-4644-9106-66ad6dbc3b6e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:08.487671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:08.488553 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:08.488854 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:08.489130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] PATH_INFO: `/v3/users/bfb7dbec22c64e06b9648da3edf8525b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:08.490290 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb7dbec22c64e06b9648da3edf8525b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:08.492214 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:08.537525 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb7dbec22c64e06b9648da3edf8525b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:08.538171 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb7dbec22c64e06b9648da3edf8525b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:08.544922 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb7dbec22c64e06b9648da3edf8525b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:08.557056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb7dbec22c64e06b9648da3edf8525b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:08.564141 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb7dbec22c64e06b9648da3edf8525b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:08.570470 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1464/2892] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:27:08 2022] DELETE /identity/v3/users/bfb7dbec22c64e06b9648da3edf8525b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:08.574957 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:08.575471 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:08.575584 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:08.593838 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:08.595056 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:08.655446 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1429/2893] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:08.665567 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:08.666968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:08.724176 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e531b-5555-4b82-9269-b86bf4423a6b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:08.727807 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:08.728479 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:08.728768 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:08.729050 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:08.738056 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:08.740081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9ed00-1f02-4d5d-bb1d-3b7602d236db service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:08.749578 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1465/2894] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:27:09.009422 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.010971 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:09.024916 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7cc5-1bf9-4c14-9509-356d7550f2e9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.029724 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.031375 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.031668 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.031946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] PATH_INFO: `/v3/projects/004ed073b8a54a9591ac875f64c69030` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.033193 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004ed073b8a54a9591ac875f64c69030)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.035052 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.082045 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004ed073b8a54a9591ac875f64c69030', 'request_id': 'req-9a92be5c-ef14-4d7f-880d-4c74c126f646'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:09.088001 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004ed073b8a54a9591ac875f64c69030', 'request_id': 'req-9a92be5c-ef14-4d7f-880d-4c74c126f646'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:09.094503 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004ed073b8a54a9591ac875f64c69030', 'request_id': 'req-9a92be5c-ef14-4d7f-880d-4c74c126f646'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:09.105469 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] The token cache is being invalidate because project 004ed073b8a54a9591ac875f64c69030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:27:09.105756 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:09.106396 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a92be5c-ef14-4d7f-880d-4c74c126f646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:09.107946 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1430/2895] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:27:09 2022] DELETE /identity/v3/projects/004ed073b8a54a9591ac875f64c69030 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:09.114531 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.114870 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.115155 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.133310 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:09.134506 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:09.150902 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:09.195495 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1466/2896] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:27:09.203521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.203818 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.204102 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.222861 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:09.224722 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:09.232509 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1431/2897] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:09.236653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.246288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ae856-2b3d-413c-b601-5ab6d8cdce76 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.250770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.251415 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.251700 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.251974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.252731 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:27:09.253037 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.254633 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.265951 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1467/2898] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:27:09.269988 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.279613 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962020-ace1-4450-8bd6-2bdef3aa6341 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.284282 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.284927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.285212 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.285491 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.286278 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.288184 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.313077 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1432/2899] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:27:09 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:27:09.317686 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.328467 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f964-fddd-4945-b389-1a48515985df admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.384961 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.385756 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.386061 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.386345 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.387051 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.389081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.408580 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1468/2900] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:27:09 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:27:09.413105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.423348 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bebd2-d56c-4aec-86a0-a5b96899585f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.428640 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.429298 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.429586 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.429868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.430603 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.432229 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.443104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1433/2901] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:27:09.446893 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.457189 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b145c-bbea-4339-8153-6d33daece42d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.462523 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.463211 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.463501 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.463785 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.464546 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.466151 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f8277-1933-41c1-b838-5d3115e82875 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.476081 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1469/2902] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:27:09.480002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.489857 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783e4e-9b6a-454f-9b1e-f3f3c8a40357 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.494400 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.495521 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.495930 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.496235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] PATH_INFO: `/v3/projects/39984e2904e247aea4a6e87b6d78f270/users/be66653f4d004dcbbee82d5f4086b57a/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.510949 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39984e2904e247aea4a6e87b6d78f270, user_id=be66653f4d004dcbbee82d5f4086b57a, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.513633 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.526564 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1434/2903] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:27:09 2022] PUT /identity/v3/projects/39984e2904e247aea4a6e87b6d78f270/users/be66653f4d004dcbbee82d5f4086b57a/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:09.537530 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.537831 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.538117 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.564562 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] MFA Rules not processed for user `be66653f4d004dcbbee82d5f4086b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:09.565795 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:09.628704 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1470/2904] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:09.640843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:09.642699 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:09.671667 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:09.710660 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291cd78-7d52-4b9c-92f5-4155f04f6edb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:09.714226 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:09.714870 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:09.715158 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:09.715438 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:09.724019 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:09.725489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb79bf-9332-4452-990c-25f765a21e2a service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:09.734442 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1435/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:27:19.625203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:19.730387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=17 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:44.446983 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:44.508829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d287f4f-e8de-4768-8b7a-fdec09d42636 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:44.513327 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:44.514203 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:44.514492 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:44.514776 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] PATH_INFO: `/v3/users/be66653f4d004dcbbee82d5f4086b57a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:44.515955 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be66653f4d004dcbbee82d5f4086b57a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:44.517925 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:44.571760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be66653f4d004dcbbee82d5f4086b57a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:44.572441 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be66653f4d004dcbbee82d5f4086b57a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:44.579318 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be66653f4d004dcbbee82d5f4086b57a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:44.591376 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be66653f4d004dcbbee82d5f4086b57a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:44.598362 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be66653f4d004dcbbee82d5f4086b57a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:44.605082 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1471/2906] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 20 14:27:44 2022] DELETE /identity/v3/users/be66653f4d004dcbbee82d5f4086b57a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:44.609662 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:44.610176 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:44.610346 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:44.628060 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:44.629788 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:44.688439 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1436/2907] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:44.698011 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:44.699432 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:44.768535 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6b972-7fd0-4a65-9917-6721cccb4538 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:44.772205 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:44.772841 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:44.773122 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:44.773395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:44.782395 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:44.783817 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9542720-c5ee-4e04-bcbd-e07e47ddfb65 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:44.793942 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1472/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:27:45.057927 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.059355 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:45.071489 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c3c4c-7c35-48d3-8d06-4a11c3833a07 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.077187 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.078094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.078434 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.078665 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] PATH_INFO: `/v3/projects/39984e2904e247aea4a6e87b6d78f270` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.079966 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=39984e2904e247aea4a6e87b6d78f270)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.082779 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.132972 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39984e2904e247aea4a6e87b6d78f270', 'request_id': 'req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:45.138296 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39984e2904e247aea4a6e87b6d78f270', 'request_id': 'req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:45.145677 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39984e2904e247aea4a6e87b6d78f270', 'request_id': 'req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:45.157131 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] The token cache is being invalidate because project 39984e2904e247aea4a6e87b6d78f270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:27:45.157421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:45.158054 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-bff2e4de-1f9d-416b-83dc-2f2c5a333aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:27:45.159630 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1437/2909] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 20 14:27:45 2022] DELETE /identity/v3/projects/39984e2904e247aea4a6e87b6d78f270 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:45.165114 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.165407 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.165687 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.182947 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:45.184158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:45.200589 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:45.244778 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1473/2910] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:45.252472 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.252774 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.253062 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.271454 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:45.272693 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:45.280617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1438/2911] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:45.285220 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.294622 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571ac9c-13bb-46bf-b5d3-2cc803db3db3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.299124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.299770 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.300084 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.300399 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.301120 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:27:45.301427 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.303027 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.314401 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1474/2912] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 20 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:27:45.318606 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.327690 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ffe3-16cc-4150-9f46-5888c2e571ad None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.333132 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.333770 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.334057 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.334336 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.335018 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.336947 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.362105 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1439/2913] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:27:45 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:27:45.365994 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.375735 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0084ff-fbea-43f0-8cec-b6b81b2aa70e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.430440 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.431167 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.431533 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.431892 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.432751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.434792 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.454943 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1475/2914] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:27:45 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:27:45.459891 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.470385 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a9f8-631f-4283-9cf9-64510a224cbd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.475777 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.476569 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.477250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.477250 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.477925 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.479573 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.490365 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1440/2915] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:27:45.494322 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.504948 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d15a-80bd-40b9-bfd4-70af261b9f78 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.509543 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.510204 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.510496 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.510779 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.511508 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.513139 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4a56-972c-49c5-9cbf-bde0dbf65972 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.524033 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1476/2916] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:27:45.528152 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.537934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1249-c4f4-41a9-a770-1444100f1134 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.542467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.543334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.543617 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.543894 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] PATH_INFO: `/v3/projects/4c581a98139043aea10590f609772f5f/users/19108692061f4d73a085081d39d0f547/roles/eb9da8ce88ff4b8880fa8fb43b026333` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.570293 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c581a98139043aea10590f609772f5f, user_id=19108692061f4d73a085081d39d0f547, role_id=eb9da8ce88ff4b8880fa8fb43b026333)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.573002 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.586560 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1441/2917] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:27:45 2022] PUT /identity/v3/projects/4c581a98139043aea10590f609772f5f/users/19108692061f4d73a085081d39d0f547/roles/eb9da8ce88ff4b8880fa8fb43b026333 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:45.591668 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e09fb-4f03-4483-a7df-7603b03eefab None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.591968 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e09fb-4f03-4483-a7df-7603b03eefab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.592284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e09fb-4f03-4483-a7df-7603b03eefab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.610950 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2e6e09fb-4f03-4483-a7df-7603b03eefab None None] MFA Rules not processed for user `96c7a0c328d14b7db355b2f838b651cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:45.612179 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e6e09fb-4f03-4483-a7df-7603b03eefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:45.671165 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1477/2918] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:45.680800 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:45.682456 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:45.704479 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:45.742342 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08966-370b-4e2f-9e01-3797f3603afd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:45.745896 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:45.746540 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:45.746822 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:45.747097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:45.756473 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:45.757915 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:45.767053 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1442/2919] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:27:49.636489 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:49.637142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:49.637142 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:49.673130 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] MFA Rules not processed for user `19108692061f4d73a085081d39d0f547`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:49.674390 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:49.701974 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:49.769803 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1478/2920] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:49.774211 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:49.785049 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851582aa-d343-4218-a0d9-fde18a87f9a5 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:49.802139 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:49.802814 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:49.803100 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:49.803379 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:49.804076 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:49.806034 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:49.850464 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1443/2921] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 20 14:27:49 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:27:49.854545 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:49.865771 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122eba-c4df-4b7d-b591-0a614ca06e94 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:49.930449 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:49.931144 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:49.931454 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:49.931717 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:49.932460 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:49.934435 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:49.957585 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1479/2922] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 20 14:27:49 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:27:49.962394 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:49.977547 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7da0-d81f-4393-933d-1b1917ed28f2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:49.982435 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:49.983121 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:49.983411 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:49.983694 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:49.984467 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:49.986094 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:49.997843 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1444/2923] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:27:50.002201 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:50.013242 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f795-a4a5-41b2-bab3-3b11647bbeda admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:50.018126 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:50.019154 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:50.020022 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:50.020468 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] PATH_INFO: `/v3/projects/839d82b121644cffa2fdd62907342a77/users/1ea6b7b36a9443a98b8a5355fd00e889/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:50.038096 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839d82b121644cffa2fdd62907342a77, user_id=1ea6b7b36a9443a98b8a5355fd00e889, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:50.040914 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:50.055619 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1480/2924] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:27:50 2022] PUT /identity/v3/projects/839d82b121644cffa2fdd62907342a77/users/1ea6b7b36a9443a98b8a5355fd00e889/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:50.059661 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:50.075714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac2ce-6ddc-4355-afc2-b7e568e1cc46 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:50.139708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:50.140418 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:50.140711 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:50.140998 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:50.142319 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:50.144641 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e05226-806b-4401-a71a-7e332b8fb7df admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:50.158631 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1445/2925] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 20 14:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:27:50.160355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:50.170747 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953771e6-b380-44d4-9281-4384f928c060 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:50.176127 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c7a0c328d14b7db355b2f838b651cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48523caa484b4c96bfa97c6efa0edb26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:50.177077 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:50.177355 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:50.177629 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] PATH_INFO: `/v3/projects/839d82b121644cffa2fdd62907342a77/users/1ea6b7b36a9443a98b8a5355fd00e889/roles/5eff81fcaccb431393e18ad18a54e1c4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:50.179577 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839d82b121644cffa2fdd62907342a77, user_id=1ea6b7b36a9443a98b8a5355fd00e889, role_id=5eff81fcaccb431393e18ad18a54e1c4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:50.182284 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:50.192568 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1481/2926] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 20 14:27:50 2022] PUT /identity/v3/projects/839d82b121644cffa2fdd62907342a77/users/1ea6b7b36a9443a98b8a5355fd00e889/roles/5eff81fcaccb431393e18ad18a54e1c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:27:54.780288 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d529-5b10-41dc-b76e-2bb2b6f2d702 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:54.780781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d529-5b10-41dc-b76e-2bb2b6f2d702 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:54.780781 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d529-5b10-41dc-b76e-2bb2b6f2d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:54.807508 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ebb9d529-5b10-41dc-b76e-2bb2b6f2d702 None None] MFA Rules not processed for user `1ea6b7b36a9443a98b8a5355fd00e889`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:27:54.808776 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ebb9d529-5b10-41dc-b76e-2bb2b6f2d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:54.888585 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1446/2927] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:27:54.905820 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:27:54.907890 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:27:54.986231 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:27:55.017579 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72980-407e-4e9c-83dc-4b6f85f4c289 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:27:55.026962 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:27:55.027636 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:27:55.027938 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:27:55.028249 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:27:55.091158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:27:55.092833 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:27:55.105705 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1482/2928] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:27:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:28:04.885387 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:05.106288 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=31 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:12.460714 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:12.461235 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:12.461344 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:12.479481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] MFA Rules not processed for user `19108692061f4d73a085081d39d0f547`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:28:12.480736 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:12.488116 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1447/2929] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:28:12.528217 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:12.529613 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:12.612883 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca1917-01a1-4317-bb25-16dc2e0d3cac service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:12.616505 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084b1b3181f34a2dacaa31f937f5d953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:12.617159 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:12.617443 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:12.617721 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:12.619504 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:12.634134 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:12.635597 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:12.648160 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1483/2930] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:12.935368 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:12.936812 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:12.993791 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af2709-dddb-48c3-821e-2282d98dd713 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:12.997367 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:12.998015 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:12.998306 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:12.998589 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:13.000407 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:13.010437 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:13.011895 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:13.020831 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1448/2931] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:13.456614 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:13.458038 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:13.466245 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:13.474934 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eefa6-45de-44c3-ba8e-1b398add44f4 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:13.478561 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:13.479198 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:13.479474 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:13.479757 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:13.481543 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:13.495772 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:13.497248 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:13.509481 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1449/2932] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:13.529311 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82672-1207-4e12-9db4-9714ff4478d0 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:13.534465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:13.535124 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:13.535413 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:13.535694 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:13.537528 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:13.550465 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:13.552078 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:13.566829 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1484/2933] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:23.504520 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=35 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:23.561760 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=67 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:26.229490 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:26.242592 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5cfc2-b0d2-4d01-9a26-0871493637ff service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:26.248236 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:26.248924 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:26.249221 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:26.249499 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:26.251329 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:26.265084 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:26.266727 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:26.278899 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1450/2934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:29.043642 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:29.053369 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f4b2-aab8-4c7e-b45b-5bdcdb6585a5 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:29.057035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:29.057661 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:29.057940 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:29.058216 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:29.067515 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:29.068986 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:29.078304 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1485/2935] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:28:36.273404 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:39.074158 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:28:39.905233 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:28:39.932244 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417107a-e84d-4f1a-838d-02648e3431b9 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:28:39.937120 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:28:39.937780 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:28:39.938070 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:28:39.938349 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:28:39.941527 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:28:39.952416 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:28:39.953868 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26d86-5aaf-4fb3-8b99-50105a832958 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:28:39.963645 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1451/2936] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:28:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:28:49.959567 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=10 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:30.886192 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:30:30.900944 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf7c0-3abc-484a-9c82-1ef44a30c18d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:30:30.907665 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6dcc9d0442c49c3ab0f852b91dce5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:30:30.908487 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:30:30.908858 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:30:30.909751 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:30:30.912071 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:30:30.929423 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:30:30.931238 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:30:30.960886 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1486/2937] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:30:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:30:31.690104 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:30:31.690672 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:30:31.690828 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:30:31.709421 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] MFA Rules not processed for user `19108692061f4d73a085081d39d0f547`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:30:31.710666 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:30:31.717890 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1452/2938] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 20 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:30:32.076895 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:30:32.087547 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78372a-5962-440b-8f44-3f3b270910dc service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:30:32.091649 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:30:32.092363 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:30:32.092653 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:30:32.092930 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:30:32.094759 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:30:32.107332 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:30:32.108840 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:30:32.117634 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1487/2939] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:30:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:30:41.703389 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:42.113742 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:30:43.175097 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:30:43.176647 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:30:43.196294 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910471-c0e6-4028-9f57-e23ca0a3a2f6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:30:43.206961 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:30:43.207954 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:30:43.208531 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:30:43.208880 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:30:43.211268 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:30:43.229006 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:30:43.230730 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:30:43.241771 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1453/2940] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:30:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:30:53.237182 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.932857 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.944223 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848b0c8-78fb-41fa-bf35-94b9245d1536 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.948671 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c845c75f561740779fe45670aacbd36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.949334 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.949755 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.950035 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.958186 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.959652 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937eb7d-1e4b-4d6f-8ff4-e5b4558df60a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.969066 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1488/2941] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:33:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:33:54.965367 dv-cinder-819149-11-iscsi devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:47.183708 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:47.250424 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356863a2-668b-4091-abd5-53ff29799194 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:47.256127 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1777a8169cdc435481082952d2fbefe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08bfa60b52d248c78ab1cfc578a49c24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:47.256813 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:47.257103 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:47.257384 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:47.267334 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:47.268999 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b3bf-e528-423e-9a77-e01f53b23096 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:47.279698 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1454/2942] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 20 14:35:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:35:57.275042 dv-cinder-819149-11-iscsi devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=27 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}